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(54) Apparatus and methods for detection and compensation of illumination flicker, detection 
and measurement of AC line frequency 



(57) A video signal including illumination fliclcer 
component Is Integrated at each of unit areas (horizontal 
lines) in a frame (field) of the video signal. The integrated 
level at each of the unit areas at the frame and the inte- 
grated level at the corresponding unit area of an adja- 
cent frame are averaged. Dividing is effected between 
results of the averaging and integrating every unit area. 
It is judged whether flicl^er exists in the video signal by 
frequency-analyzing results of the dividing result at the 
unit areas. The unit area may be plural adjacent lines 
w/here flickering are negligible. The averaging circuit 



may be circulation type of or FIR filter. Threshold level 
forjudging the flicl^er is changed according to a shutter 
speed control signal. Flicker compensation may be ex- 
ecuted by controlling shutter speed or the AGC accord- 
ing to flicker judging result. A still condition at a block in 
a frame may be detected from the integration resull.at 
plural frames. When the block is judged to be still, the 
flicker is judged. An ac line frequency detection is also 
disclosed to detect the frequency of the ac line from a 
video signal generated under illumination including flick- 
er. An imaging circuit may be provided to generate the 
video signal therein. 
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Description 

BACKGROUND OF THE INVENTION 
5 1 . Field Of the Invention 

[0001] This Invention relates to an illumination flicker detection apparatus, an illumination flicker compensation ap- 
paratus, and an ac line frequency detection apparatus, methods of detecting illumination flicker, compensating flicker, 
and measuring ac line frequency. 

10 

2. Description of the Prior Art 

[0002] An illumination flicker detection apparatus for detecting flicker in a video signal which is generated by a video 
camera under illumination by fluorescent lamps are known. Moreover, a video signal processing apparatus for sup- 

15 pressing the affection by flicker in the video signal is also known. 

[0003] When image is taken by a video camera under illumination by fluorescent lamps, there is a problem of flicker. 
Illumination level of the fluorescent lamp periodically changes with voltage variation of the ac line. Figs. 19A to 19D 
are illustrations of a prior art showing a relation between lunr^inance changes of fluorescent lamps and the image 
shooting operation. If the cycle of the voltage of ac line is 50 Hz as shown in Fig. 19A. the luminance of a fluorescent 

20 lamp changes at 100 Hz as shown In Fig. 19B. 

[0004] Fig. 19C is an illustration showing operation of a prior art video camera. If a video camera or an electronic 
camera employing a MOS type of Imager is used under illumination by fluorescent lamps at a shutter speed of 1/30 
sec, charge storing timings and the luminance level of the video signal are shown in Fig. 190. 
[0005] The MOS type of imager outputs a first line from timing A1 to B1 and a second line from timings A2 to B2 

25 which timings A2 and B2 are slightly shifted in time base from the timings A1 and B1 as shown in Fig. 1 9C. As shown 
in Fig. 1 9B, the luminance level changes, so that a luminance level of the image changes at a cycle of 1/1 00 sec, which 
is sensed by a watcher as black stripes on the reproduced image. 

[0006] Particularly, in the case of the MOS type of imager, the reproduced image shows stripes over the to-be- 
reproduced image because the image storing timings are different with respect to the variation in the luminance of the 
30 fluorescent lamps every line. 

[0007] Figs. 20A to 20D are illustrations of a prior art showing a relation between luminance changes of fluorescent 
lamps and image shooting operation at 60 Hz. If the cycle of the voltage of ac line is 60 Hz as shown in Fig. 20A, the 
luminance of a fluorescent lamp changes at 120 Hz as shown in Fig. 20B. 

[0008] Fig. 20G is an illustration showing operation of a prior art video camera. If a video camera or an electronic 
35 camera employing a MOS type of imager is used under illumination by fluorescent lamps at a shutter speed of 1/50 
sec, charge storing timings and the luminance level of the video signal are shown in Fig. 20C. 
[0009] In the MOS type of imager, rays entering respective pixels on a first line are converted into charges which 
are accumulated from timings All to B11 and charges on a second line are accumulated from timings A21 to 821 
which timings A21 and B21 are slightly shifted in time base from the timingsAII and B11 . As shown in Figs. 20B and 
40 20C, the luminance level changes, so that brightness level of the shot image changes, which is sensed by a watcher 
as black stripes on the reproduced image. 

[0010] In the case of 60 Hz, because the frame inten/al is an integer times the illumination level variation period, 
luminance level variation does not occur every frame. However, if the ac line frequency varies around 60Hz, black 
stripes move every frame, so that quality of the reproduced image is deteriorated. In the MOS type of imager, charge 
45 accumulating timings are different from each other as similarly as the case of 50 Hz, so that the flicker occurs within 
one frame, which is sensed by watcher as black stripe on the reproduced image. 

[001 1] A prior art flicker compensating apparatus for compensating the video signal is also known. Japanese patent 
application provisional publication No. 8-1 5324 discloses such a flicker compensating apparatus. This flicker compen- 
sating apparatus detects the presence or absence of flicker by an integrating result of a video signal at the present 
50 field and an integrating resultof the video signal at the previous field and comparing the difference between the present 
and the previous fields with a threshold level and switching the shutter speed In accordance with the presence and the 
absence of flicker 

SUMMARY OF THE INVENTION 

55 , 

[0012] The aim of the present invention is to provide superior Illumination flicker detection apparatus, illumination 
flicker compensation apparatus and ac line frequency measuring apparatuses and superior methods of detecting illu- 
mination flicker, compensating flicker, and measuring ac line frequency. 
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[0013] According to the present invention, a first aspect of the present invention provides an illumination flicker de- 
tection apparatus comprising: integrating means for integrating levels of a video signal at pixels at each of unit areas 
- included in a frame or field of said video signal; averaging means for averaging said integrated level at each of said 
unit areas at said frame or field and said integrated level at the corresponding unit area at an adjacent previous frame 
5 or field; dividing means for effecting division between results of said averaging and integrating means every unit area; 
and flicker judging means forjudging whether flicker exists in said video signal by frequency-analyzing results of said 
dividing means iat said unit areas and outputting a judging result. 
[0014] Preferably, said unit area is a horizontal line. 

[0015] Preferably, said unit area is a plurality of adjacent horizontal lines where variation in said levels due to said 
10 flicker is negligible. 

[0016] Preferably, each of said unit areas includes a plurality of horizontal lines with inten/al at a frame, which hori- 
zontal line show the same phase in flicker component in said video signal. 
[0017] Preferably, said averaging means comprising a circulation type of filter. 
[0018] Preferably, said averaging means comprising a Finite Impulse Response filter 

[0019] Preferably, the illumination flicker detection apparatus further comprises: first summing means for summing 
said result of said integrating means at said frame or field and said result of said integrating means at another frame 
or field at every said unit area; and second summing means for summing said results of said averaging means at said 
frame or field and said result of said averaging means at said another frame or field at every unit area, wherein said 
another frame or field is prior to said frame or field by a predetermined number of frames or fields which is determined 
by a frequency of said flicker and a frame frequency of said video signal and said dividing means effects said division 
between said results of first and second summing means. 

[0020] Preferably, the illumination flicker detection apparatus further comprises: first summing means for summing 
said results of said integrating means of a predetermined number of adjacent frames or fields at every unit area said 
adjacent frames or fields including said frame or field; and second summing means for summing said results of said 
averaging means of said adjacent frames or fields at every unit area, wherein said dividing means effects said division 
between said results of first and second summing means. 
[0021] Preferably, the illumination flicker detection apparatus, further comprises another averaging means for aver- 
agmg said results of said dividing means at a plurality of said unit areas at said frame or field, wherein each of said 
unit areas includes a plurality of horizontal lines with interval at a frame, said horizontal lines showing the same phase 
30 in flicker component in said video signal. 

[0022] Preferably, the illumination flicker detection apparatus, further comprises threshold level generating means 
for generating a threshold level in accordance with a shutter speed control signal which is used for generating said 
video signal, wherein said flicker judging means judges whether said flicker exists In said video signal usinq said 
threshold leveL 

[0023] According to the present InvenUon. a second aspect of the present invention provides an illumination flicker 
compensation signal generation apparatus comprising: integrating means for integrating levels of a video signal at 
pixels at each of unit areas included in a frame or field of said video signal; averaging means for averaging said Inte- 
grated level at each of said unit areas at said frame or field and said integrated level at the corresponding unit area at 
an adjacent frame orfleld; dividing means for effecting division between results of said averaging and integrating means 
every unit area; flicker judging means for judging whether flicker exists in said video signal by frequency-analyzing 
results of said dividing means at said unit areas and outputting a judging result; and flidker compensation means for 
generating a shutter speed control.slgnal and an automatic gain controlling signal for generating said video signal in 
accordance with said judging result of said flicker judging means to compensate flicker in said video signal. 
[0024] According to the present invention, a third aspect of the present invention provides a method of detecting 
flicker in a video signal comprising the steps of: (a) integrating video levels of a video signal at pixels at each of unit 
areas included in a frame or field of said video signal; (b) averaging said integrated level at each of said unit areas at 
said frame or field andsaid integrated level at the conresponding unit areas at an adjacent frame or field- (c) effecting 
division between results of said steps of (a) and (b) every, unit area; and (d) judging whether flicker exists in said video 
signal by frequency-analyzing results of said step (c) at said unit areas and outputting a judging result. • 
[0025] According to the present invention, a fourth aspect of the present invention provides a method of compensating 
flicker in a video signal comprising the steps of: (a) integrating vkieo levels of a video signal at pixels at each of unit 
areas included in a frame or fleld of said video signal; (b) averaging said integrated level at each of said unit areas at 
said frame or fieldand said integrated level at the corresponding unit areas at an adjacent frame or field- (c) effecting 
division between results of said steps of (a) and (b) every unit area; (d) judging whether flicker exists in said video 
signal by frequency-analyzing results of said step (c) at unit areas and outputting a judging result; and (e) generating 
a shutter speed control signal and an automatic gain controlling signal in accordance with said judging result of said 
step (d) to compensate flicker in isaid video signal; 

[0026] According to the present invention, a fifth aspect of the present invention provides an illumination flicker de- 
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tection apparatus comprising: integrating means for integrating levels of a video signal at pixels at each of unit areas 
included in a frame or field of said video signal; averaging means for averaging said integrated level at each of said 
unit areas at said frame or field and said integrated level at the corresponding unit area at an adjacent frame or field; 
still portion judging means for judging whether image at every block including a portion of said unit areas at a frame is 

5 still in accordance with result of said integrating means; dividing means for effecting division between results of said 
averaging and integrating means every unit area; and flicker judging means for judging whether flicker exists in said 
video signal in accordance with results of said dividing means and said still portion judging means. 
[0027] Preferably, said unit area is a horizontal line. 
. [0028] Preferably, said unit area is a plurality of adjacent horizontal lines where variation of said video. levels due to 

10 said flickering is negligible. 

[0029] Preferably, said blocks are arranged in the vertical direction at a frame or a field, a vertical length of each 
block is determined in accordance with an integer times one cycle of illumination variation due to an ac line voltage, 
used for generating said video signal and a frame frequency of said video signal. Moreover, still portion judging means 
may comprise: summing means for summing integration results of unit areas at every said block; variation detection 

15 means for detecting variation in result of said summing means between each of said blocks of the present frame or 
field and the corresponding block of a previous frame or field; and comparing means for comparing said variation with 
a threshold value, wherein said still portion judging means judges that image at each of said blocks is still when said 
variation is lower than said threshold value. 

[0030] In this case, said variation detection means may comprise: difference calculation means for calculating a 

20 difference in results of said summing means between each of said blocks of the present frame or field and the corre- 
sponding block of a previous frame or field; dividing means for dividing result of said difference calculating means by 
said result of said summing means of said present frame or field; and comparing means for comparing result of said 
dividing means with a threshold value, wherein said still portion judging means judges that image at each of said blocks 
is still when said result of said dividing means is lower than said threshold value. Preferably, said variation detection 

25 means comprises: variation detection averaging means for averaging results of said summing means between present 
and previous frames or fields at each of said blocks; difference calculation means for calculating a difference in result 
of said summing means and said result of said variation detection averaging means; dividing means for dividing result 
of said difference calculating means by said result of said summing means of said present frame or field; and comparing 
means for comparing result of said dividing means with a threshold value, wherein said still portion judging means 

30 judges that Image at every block areas is still when said result of said dividing means is lower than said threshold value. 
[0031] According to the present Invention, a sixth aspect of the present invention provides an illumination flicker 
compensation signal generation apparatus comprising: integrating means for integrating levels of a video signal at 
pixels at each of unit areas included in a frame or field of said video signal; averaging means for averaging said inte- 
grated level at each of said unit areas at said frame or field and said integrated level at the corresponding unit area of 

35 at least an adjacent frame or field; still portion judging means for judging whether image at every block including a 
portion of said unit areas at a frame is still in accordance with result of said iritegrating means; dividing means for^ 
effecting division between results of said averaging and integrating means every unit area; flicker judging means for 
judging whether flicker exists in said video signal in accordance with results of said dividing means and said still portion 
judging means; and flicker compensation means for generating a shutter speed control signal and an automatic gain 

40 controlling signal for generating said video signal in accordance with said judging result of said flicker judging means 
to compensate flicker in said video signal. 

[0032] According to the present invention, a seventh aspect of the present invention provides a method of compen- 
sating flicker in a video signal comprising the steps of: (a) integrating levels of a video signal at pixels at each of unit 
areas included in a frame or field of said video signal; (b) averaging said integrated level at each of said unit areas at 
45 said frame or field and said integrated level at the corresponding unit area at an adjacent frame or field; (c) judging 
whether image at every block including a portion of said unit areas is still in accordance with result of said step (a); (d) 
effecting division between results of said steps of (a) and (b) every unit area; and (e) judging whether flicker exists in 
said video signal in accordance with results of said steps (c) and (d). 

[0033] According to the present invention, an eighth aspect of the present invention provides a method of compen- 
50 sating flicker in a video signal comprising the steps of: (a) integrating levels of, a video signal at pixels at each of unit 
arieas included in a frame or field of said video signal; (b) averaging said integrated level at each of said unit areas at 
said frame or field and said integrated level at the corresponding unit area at an adjacent frame or field; (c) judging 
whether image at every block including a portion of said unit areas is still in accordance with result of said step (a); (d) 
effecting division between results of said steps of (a) and (b) every unit area; and (e) judging whether flicker exists in 
55 said video signal in accordance with results of said siteps (c) and (d); and (f) generating a shutter speed control signal 
and an automatic gain controlling signal for generating said video signal in accordance with said judging result of said 
step (e) to compensate flicker in said video signal. 

[0034] According to the present invention, a ninth aspect of the present invention provides an ac line frequency 
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detection apparatus comprising: flicker component detection means for detecting a flicker component In a video signal 
generated with illumination of which luminance varies with ac line voltage: and flicker judging means for judging whether 
; flicker exists in said video signal in accordance with said detected flicker component and outputting the judging result. 
[0035] Preferably, said flicker component detection means comprises: integrating means for integrating levels of said 
5 video signal at pixels at each of unit areas included in a frame or field of said video signal; averaging means for averaging 
said integrated level al each of said unit areas at said frame or field and said integrated level at the corresponding unit 
area at an adjacent frame or field; dividing means for effecting division between results of said averaging and integrating 
means every unit area to output said detected flicker component. 

[0036] Preferably, said flicker judging means comprises: variation analyzing means for analyzing variation of said 
10. detected flicker component with respect to horizontal lines. 

[0037] -Preferably, said flicker judging means comprises: spectrum analyzing means for analyzing spectrum of said 
flicker component. 

[0038] Preferably, said unit area is a horizontal line. 

[0039] Preferably, the ac line frequency measuring apparatus further comprises: imaging means for generating a 
15 video signal with illumination of which luminance varies with ac line voltage. 

[0040] According to the present invention, a tenth aspect of the present invention provides a method of measuring 
an ac line frequency comprising the steps of: (a) detecting a flicker component in a video signal generated with illumi- 
nation of which luminance varies with ac line voltage; and (b) judging whether flicker exists in said video signal in 
accordance with said detected flicker component. . 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0041] The object and features of the present invention will become more readily apparent from the following detailed 
description taken in connection with the accompanying drawings in whfch: 



Fig. 1 is a block diagram of an illumination flicker detection apparatus according to this invention; • 
Figs. 2A and 2B are illustrations of averaging operation, referred in the first, eleventh, and sixteenth embodiments; 
Fig. 3 is a block diagram of the flicker judging circuit referred in the first and eleventh embodiments; 
Fig. 4A is a graphical drawing, showing the output of the dividing circuit, referred in the first, eleventh, and eighteenth 
30 embodiments; 

Fig. 4B is a graphical drawing, showing the output of the DFT circuit, refen-ed in the first, eleventh, and eighteenth 

embodiments; 

Fig. 5 is an illustration of integration operation according to a second embodiment; 

Figs. 6A and 6B show arrangements of color filters for single plate imagers and processing In the second embod- 
^ iment; 

Fig. 7 is an illustration according to a third embodiment; 

Fig. 8 is a block diagram of an averaging unit according to a.fourth embodiment; 

Fig. 9 is a block diagram of the averaging unit according to a fifth embodiment; 

Fig. 1 0 is a block diagram of the summing units according to a sixth embodiment; 
"fo Fig. 11 is another example of the summing units according to the sixth embodiment; 

Fig. 12 is a block diagram of the summing units according to a seventh embodiment; 

Fig. 13 is a block diagram of the averaging block according to an eighth embodiment; : 

Fig. 1 4 is a block diagram of the fllckisr judging circuit according to a ninth embodiment; - 

Figs. 15A and 15C are graphical drawings showing the outputs of the dividing circuit when the shutter speed Is 
^ high and low, respectively; 

Figs. 1 5B and 1 5D are graphical drawings showing flicker components detected by the DFT circuit when the shutter 

speed is high and low, respectively; 

Fig. 1 6 is a block diagram of the imaging apparatus according to a tenth embodiment; . . 

Fig. 17 depicts a flow chart showing operation of the flicker compensation signal generation circuit accordlnq to 

50 the tenth embodiment; 

Figs. 18A and 1 8B are graphical drawings showing the gain controlling and the shutter controlling referred in tenth 
and fifteenth embodiments;. 

Figs. 1 9A to 1 9D are illustrations of a prior art showing a relation between luminance changes of fluorescent lamps 
and the image shooting operation; 

Figs. 20A to 20D are illustrations of a prior art showing a relation between luminance changes of fluorescent lamps 
and image shooting operation al 60 Hz; . 
Fig, 21 is a block diagram of the illumination nicker detection apparatus according to an eleventh embodiment; 
Fig.. 22 shows summing or averaging operation according to the eleventh embodiment; . 
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Fig. 23 is a block diagram of the flicker judging circuit according to the eleventh embodiment; 

Fig. 24 is an illustration showing summing operation according to the eleventh embodiment; 

Fig. 25 Is an illustration showing operation of the still portion judging circuit according to the eleventh embodiment; 

Fig. 26 is an illustration showing operation of the integration circuit according to a twelfth embodiment; 
5 Fig. 27 is an illustration showing summing or averaging operation according to the twelfth embodiment; 

Fig. 2B is an. illustration showing summing operation according to the twelfth embodiment; 

Fig. 29 is an illustration showing the still portion judging operations according to the twelfth embodiment; 

Fig. 30 is a block diagram of the still portion judging circuit according to a thirteenth embodiment: 

Fig. 31 is a block diagram of the still portion judging unit according to a fourteenth embodiment; 
10 Fig. 32 is a block diagram of the imaging apparatus according to a fifteenth embodiment; 

Fig. 33 depicts a flow chart showing operation of the flicker compensation signal generation circuit according to 

the fifteenth embodiment; 

Fig. 34 is a block diagram of the ac line frequency detection apparatus, according to a sixteenth embodiment; 
Fig. 35 is a graphical drawing illustrating ac line frequency operation according to the sixteenth embodiment; 
15 Fig. 36 depicts a flow chart showing ac line frequency operation according to the sixteenth embodiment; 

Fig. 37 is a block diagram of the ac line frequency detection apparatus according to a seventeenth embodiment; 
Fig. 38 is a block diagram of the ac line frequency detection circuit shown in Fig. 37; and 
Fig. 39 is the ac line frequency detection apparatus according to an eighteenth embodiment. 

20 [0042] The same or con^esponding elements or parts are designated with like references throughout the drawings. 

DETAILED DESCRIPTION OF THE IfSlVENTION 

<FIRST EMBODIMENT> 

25 

[0043] Fig. 1 is a block diagram of an illumination flicker detection apparatus according to this invention. 

[0044] The illumination flicker detection apparatus includes an integrating circuit 1 , an averaging unit 6 including a 

memory 2 and an averaging circuit 3, a dividing circuit 4, and a flicker judging circuit 5. 

[0045] A video signal is inputted to the integrating circuit 1 . The integrating circuit 1 integrates pixel levels of a video 
30 signal in every horizontal line (unit area) at a frame (field). The memory 2 stores the integration result over a plurality 
of frames (fields). The averaging circuit 3 averages the integration results of horizontal lines at a plurality of frames 
(fields) from the integration result fronn the integrating circuit 1 and the memory 2. The dividing circuit 4 divides the 
integration results of horizontal lines by the averaged result of horizontal lines, respectively. The flicker judging circuit 
5 judges whether illumination flicker exists in the video signal by frequency-analyzing the dividing results of horizontal 
35 lines. 

[0046] This illumination flicker detection apparatus is provided with a discrete circuit in this embodiment. However, 
the illumination flicker detection apparatus is also provided with a Digital Signal Processor (DSP), or a computer with 
a program. 

[0047] The video signal is generated by a video camera (not shown in Fig. 1 ) under illumination of which luminance 
40 varies in accordance with the voltage change of the ac line. That is, an image of an object illuminated by fluorescent 
lamps is shot by the video camera. 

[0048] Figs. 2A and 2B are illustration of the first embodiment. 

[0049] The integration circuit 1 integrates, accumulates, or averages the pixel levels (luminance level) at every hor- 
izontal line (unit area). The integrating result of i*^ line of n^^ frame is represented by SUMpj as shown in Fig. 2A. If one 

45 frame of the video signal includes 480 lines, the integration circuit 1 calculates the integration result SUM„^ to SUM^ 
for i = 1 to 480. ' . 

[0050] The memory 2 successively stores a predetermined number of frames (fields) of the integration result. The 
averaging circuit 3 effects addition or averaging among SUM^ j from the integration circuit 1 , SUM^j.^ j, SUM„.2,i. and 
SUIVln.3 1 from the memory 2. Fig. 2B shows the summing or averaging operation from the integration results of the 

50 present frame and the previous frames. The memory 2 stores the integration result SUM^ | and outputs the integration 
results SUM^.^ i, SUMn.2 j. SUMn.3 j, at the i**' line at frames n-l to n-3. The averaging circuit 3 averages (sums) SUMnj. 
SUMp.^ j, SUM^2.i« and SUM^3 j. That is, the averaging circuit 3 averages the integrated level at each of the unit areas 
at the present frame or field and the integrated level at the corresponding unit area at an adjacent previous frame or 
field. The averaging result is represented as AVE^ j. In this embodiment, the number of the previous frames per one 

S5 unit averaging operation is three. However, it is also possible that, at least, the integration results of more than one 
previous frames are added to the integration result of the present frame. 

[0051] The dividing circuit 4 obtains SUMn / AVEnj through calculation from the output SUM^j of the integration 
. circuit 1 and the output AVE^ j of the averaging circuit 3. That is, the dividing circuit 4 effects division between results 



6 



NSDOCID: <EP 1091571A2J_> 



e 



EP 1 091 571 A2 

of the averaging and integration every unit area. The flicker judging circuit 5 judges whether there is flicker with the 
dividing result of the dividing circuit 4. Fig. 3 is a block diagram of the flicker judging circuit 5. The flicker judging circuit 
5 includes a D FT (Discrete FourierTransform) circuit 21 sjppliedwith the division resultSUM„j/AVEni and acompahng 
circuit 22 for comparing the output of the DFT circuit 21 with threshold values. 
5 [0052] Fig. 4A is a graphical drawing showing the output of the dividing circuit 4 according to the first embodiment, 
wherein the axis of abscissas represents line number at a frame and the axis of ordinates represents levels of dividing 
results, that is. SUM^ /AVEn j. The dividing results shows flicker. 

[0053] Fig. 4B is a graphical drawing showing the output of the DFT circuit 21 according to the first embodiment, 
wherein the axis of abscissas represents frequency and axis of ordinates represents levels of frequency components! 
10 [0054] The DFT circuit 21 effects Discrete Fourier Transform operation to output frequency components as shown 
in Fig. 4B from the division result of the division circuit 4. 

[0055] The line represents the level of the DFT circuit 21 at 50 Hz. i.e.. component of 50 Hz. and the line F60 
represents the level of the DFT circuit 21 at 60 Hz, i.e.. component of 60 Hz. 

[0056] The comparing circuit 22 compares the results F50 and F60of the DFT circuit 21 with threshold levels THgo^^^, 
THeo-ON. TH50.0FF. and THgo^oFF- There are relations. TH5o.o^ > TH50.0FF and TH60.0N > TH6o.opp. 
[0057] Basically, the comparing circuit 22 compares the component with the threshold levels TH50.0N and 
T^Hso^OFF and the component Fg^ with the threshold levels TH60.0N and THsq-off to ^^etect flicker at 50Hz and 60 Hz 
in the video signal. 

[0058] More specifically, the comparing circuit 22 judges the flicker as follows: 

[0059] When (the value of) F50 < TH50.0FF and (the value of) Feo < THgo-oPF. the comparing circuit 22 judges that 
there is no flicker. 

[0060] When a x Fgo < F50 and F50 > TH^o.^^. the comparing circuit 22 judges there is flicker of 50 Hz. 
[0061] When p X F50 < Fgo and F^o > THgooN. the comparing circuit 22 judges there is flicker of 60 Hz. 
[0062] In other cases, the comparing circuit 22 judges that it is unknown that there is flicker. 
[0063] In the above equations, a is a weighting coefficient forflicker detection of 50 Hz and p is a weighting coefficient 
for flicker detection of 60 Hz. These coefficients are sufficiently greater than one, so that if the frequency component 
(Feo) is greater than the value of the weighting-coefficient-times the frequency component F^q (F50), the comparing 
circuit 22 judges there.is flicker of 50 Hz (60 Hz). This reduces probability of enroneous judgment of existence of flicker 
due to luminance leveJ change within a frame representing an image. 

[0064] As mentioned above, according to this embodiment, the existence of flicker is judged from the average of 
integration values over a plurality of frames (fields) including the present frame at the con-esponding lines. Thus, the 
flicker detection can be provided without influence of luminance level variation due to motion of the image. Moreover, 
this structure (this method) provides illumination flicker detection of 60 Hz wherein luminance level variation. 
[0065] in the first embodiment, the Integration circuit 1 integrates the pixel values every horizontal line. However, it 
is also possible that the integration circuit 1 integrates the pixel value on thinned horizontal lines, wherein thinning 
period is sufficiently shorter than the period of flicker (beat) component. In this case, the circuit stage after the integration 
circuit 1 effects the above-mentioned operation for the thinned horizontal lines. Thus, the capacity of the memory 2 
can be reduced. 

40 <SECOND EMBODlMENT> 

[0066] An illumination flicker detection apparatus according to a second embodiment has substantially the same 
structure as that of the first embodiment. The difference is that the integrating circuit lb effects integration every a 
plurality of horizontal lines in which the flicker component level is considered to be substantially the same. That is, the 
45 video (luminance) levels of pixels are integrated or averaged every adjacent or consecutive three lines i'*^ (i-hl )th line 
arid (\+2y^ line and outputted. 

[0067] Fig. 5 is an illustration of integration operation according to the second embodiment. 

[0068] It is assumed that the integrated or averaged values of video levels of all significant pixels on the i^^ line, 

(i-Fl )th line, and (i+2)»h line at n^^^ frame are represented as SUM„, and that on the (i+3)^h |jne. (i+4)»h line, and (i+-5)th 

50 line at n^^' frame is represented as SUM^i+i . 

■■ [0069] This embodiment is effective for video signals obtained from imagers using color filters. Figs. 6A and SB show 
' arrangements of color filters for single plate imagers and processing in this embodiment. The arrangement shown in 
Fig. 6A is for the complementary filter structure and the arrangement shown in Fig. 6B is a portion of Bayer an-angement 
for primary color filter structure. As shown in Figs. 6Aand 5B, different color filters are arranged and adhered on imagers. 

55 [0070] In the.cdmplemeritary color filter type of imager, a first line and a second line are alternately arranged, wherein 
a cyan filter Cy and a yellow filter re are alternately arranged every pixel on the firet line and a magenta filter Mg and 
a green.filterare alternately arranged every pixel on the second line. In the integrating the video levels of pixels In two . 
consecutive lines, four pixels surrounded with a.chain line are dealt as one block. The video signal level in one block 



15 



20 



25 



30 



35 



7 



SDOCrO: <EP ^1091 571 A2J_> 



EP 1 091 571 A2 



Is represented as 

Cy + Mg + Te + G = 2R 4- 3G + 2B = T 

5 

[0071] Then, the video signal level In one block provides substantially the same level as the luminance signal. This 
signal similar to the luminance signal is integrated and the integrated result is used for detecting flicker, so that accurate 
flicker detection is provided. 

[0072] In the arrangement shown in Fig. 6B, one line where R and G filters are alternately arranged and another line 
10 where G and B filters are alternately arranged. In integration on these two lines, four pixels surrounded by a chain line 
are dealt as one block and values in a plurality of blocks are integrated. The video signal level in one block is represented 

as 



[0073] Thus, the video signal level in one block is substantially the same as the luminance signal T. This video signal 
similar to the luminance signal is integrated every a plurality of horizontal lines (two lines), so that accurate flicker 
detection is provided. 

20 [0074] As mentioned above, according to the second embodiment, the integration of video signal levels is effected 
every plural lines in which levels of flicker component can be considered as substantially the same. Thus, this structure 
reduces affection of luminance level variation of an object image, so that accurate flicker detection is provided. 

<THIRD EMBODIMENT> 

25 

[0075] An illumination flicker detection apparatus according to a third embodiment has substantially the same stmc- 
ture as that of the first embodiment. The difference is that the integrating circuit 1c integrates the video levels of pixels 
on a plurality of horizontal lines which are apart from each other by a period in accordance with the flicker and frame 

frequencies. 

30 [0076] Fig. 7 is an illustration according to the third embodiment. >■ 

[0077] In the case that an image is shot under illumination using the ac line of 50 Hz. there are periodical level 
variations (3 -i- 1/3) times a frame as shown in Fig. 7. In the case of 60 Hz, there are four periodical level, variations on 
a frame. 

[0078] Then, the integrating circuit 1c integrates the video signal level on the horizontal lines (unit area) showing the 
35 same phase in the illumination flicker. That is, the integration circuit ic integrates or averages video levels of pixels on 
the line, (j -i- p)*^^ line, and (j + 2)*^^ line. This level is represented as SUM^j. The averaged value of the video levels 
of pixels on the j**^ line, (j + p)*^' line, and (j -i- 2)^^^ line is represented as SUM^j+i. 

[0079] Each of the unit areas includes a plurality of horizontal lines with inten^al at a frame, which horizontal lines 
show the same phase in flicker component in said video signal. The number of the horizontal lines in each unit area 
40 is determined in accordance with the division of the flicker frequency (for example, 1 0OHz) by the frame frequency (for 
exampfe, 30 HZ) when the flicker frequency is indivisible by the frame frequency. 

[0080] As mentioned above, in:the third embodiment of this invention, the video signal levels are integrated every a 
plurality of horizontal lines showing the same phase in the beat frequency between the Illumination flicker and the 
frame cycle. Moreover, the integrated values are averaged over a plurality of frames including the present frame and 
45 previous frames and the averaged values are used in judging whether flicker is present. Thus, variation in luminance 
due to the image of an object can be reduced, so that accurate illumination flicker detection is provided. Moreover, the 
number of integration result SUM^ is one third of the integration result SUMpj of the first embodiment. Thus, the capacity 
of the memory 2 can be reduced to one third. 

50 <FOURTH EMBODIMENT> 

[0081 ] An illumination flicker detection apparatus according to a fourth embodiment has substantially the same stmc- 
ture as that of the first embodiment. The difference is that the averaging circuit 3b is used instead the averaging circuit 
3 of the first embodiment. 
55 [0082] Fig. 8 is a block diagram of the averaging unit 6b according to the fourth embodiment. 

[0083] The averaging unit 6b includes a multiplier 31 . an adder 32. a memory 33, and a multiplier 34. The multiplier 
31 multiplies the output SUM„ | of the integration circuit 1 by a coefficient (1 - k). The adder 32 adds an output of the 
multiplier 34 to the output of the multiplier 31. The memory 33 temporarily stores the output of the adder 32. The 
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multiplier 34 multiplies an output AVE^j of the memory 33 by the coefficient k. The coefficient k is a predetermined 
circular coefficient, wherein 0 ^ k ^ 1. 

[00841 The multiplier 31 multiplies the output SUM^.j of the integration circuit 1 by (1 - k) and supplies the result to 
the adder 32. The memory 33 stores one frame of the output of the adder 32 and outputs an averaged signal AVE^ j 
which is delayed by one frame from the output SUM^ j. The multiplier 34 multiplies the averaged signal AVE^i by k! 
The adder 32 adds the output (1 - k) x SUM„ | to the output k x AVE„ ; of the multiplier 34 and supplies the oulpul to 
the memory 33. . ' 

[0085] Accordingly there Is a relation between the input SUM^ j of the averaging unit 6b and the averaged signal as 
follows: 



AVE„ j = (1 - k) X SUM„ J + k X AVE„.i i = (1 « k) x SUM„ ^ + k x 
(10k) X SUM^i J -I- k^ X (1 - k) X SUM„.2,i + 

15 

[0086] As mentioned above, averaging has been effected over previous infinite frames with the circulation type of 
filter, so that dividing can be effected with stable values. Thus, illumination flicker detection Is provided without affection 
due to luminance level variation due to motion of an object in the image. 

20 <FIFTH EMBODIMErMT> 

[0087] An illumination flicker detection apparatus according to a fifth embodiment has substantially the same structure 
as that of the first embodiment. The difference is that the averaging unit 6c is used instead the averaging unit 6 of the 
first embodiment. The averaging unit 6c includes an FIR (Finite Impulse Response) filter. 

25 [0088] Fig. 9 is a block diagram of the averaging unit 6c according to the fifth embodiment. The averaging unit 6c 
- includes a memory 2c. multipliers 35 to 3a. and an adder 39 as an FIR filter. 

[0089] The memory 2c outputs one-frame-delayed to three- frame-delayed integrated signals SUM - SUM ^ - 
and SUM^3 j. The multiplier 35 multiplies the integrated signal SUM„ j by a„The multiplier 36 multiplies the one-frame- 
delayed integrated signal SUM^.^ ^ by tv,. The multiplier 37 multiplies the two-frame-delayed integrated signal SUM ^ . 

30 by a^,2- The multiplier 38 multiplies the three-frame-delayed integrated signal SUM„.3 1 by a „ 3. The adder 39 effects 
addition among the outputs of the multipliers 35 to 38 and outputs an averaging result AVE^j^g. Accordingly, there is 
a relation between the input SUM^j of the averaging unit 6c and the averaged signal AVE^ ^.g as follows: 

35 AVE^i = a„ X SUM„ J ^- a„., x SUM^, ^ + x SUM^a.i + 

a^3 X SUM^3 

[0090] In the case of 60 Hz illumination, if the frame period is 1/30 sec, the flicker component every frame gradually 
40 changes. This FIR type of averaging unit 6c provides illumination flicker detection by obtaining the averaged signal 
AVEn j from integration result SUM^ , including such gradual change in luminance due to "flicker at 60 Hz by setting the 
coefficients a„.i,an.2.an.3. .. . 

[0091] As mentioned above, according to the fifth embodiment, averaging is effected with the FIR filter, so that the 
integrated data can be averaged with a desired characteristic. Thus, accurate illumination flicker detection'is provided. 

<SIXTH EMBODIMENT> 



[0092] An illumination flicker detection apparatus according to a sixth embodiment has substantially the same stnjc- 
ture as that of the first embodiment. The difference is that the summing units 1 0a and 1 0b are further provided between 
the Integration circuit 1 and the dividing circuit 4 and between the averaging circuit 3 and the dividing circuit 4 resoec- 
tlvefy. 5» . . . 

[0093] Fig. 10 is a block diagram of the summing units 10a and 10b according to the sixth embodiment. 
[0094] The summing unit Ipa includes a memory 41 storing the Integrated signal SUM„ j and outputting a three- 
frame-delayed Integrated signal SUM„.3i and a first adder 42 for adding the three-frame delayed integrated signal 
SUMn.3j to the Integrated signal SUM^ j and supplies the adding result to the dividing circuit 4. 
[0095] The summing unit 1 0b includes a memory 43 storing the averaged signal AVE^ and outputting a three-frame- 
delayed averaged signal and an adder 44 for adding the three-frame delayed averaged signal AVE^3 j to the averaged 
signal AVE^ j and supplies the adding result to the dividing circuit 4. The dividing circuit 4 divides the adding result from 
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the adder 42 by that from the adder 44. Thus, the output of the dividing circuit 4 is represented by: 

D1 = (SUM, J ^ .) / (AVE„ J + AVE„.3 .) 

5 

. [0096] In the case of 50 Hz, if the frame period is 1/30 sec, the flicker appears with, the same pattern on every three 
frame. Thus, the integrated signal of the present frame is added to the integrated signal of the three-frame-delayed 
integrated signal and the averaged signal of the present frame is also added to the averaged signal of the three-frame- 
delayed averaged signal to remove the influence by the shot image of the object in the video signal. 
10 [0097] In this example, the integrated signal SUM^ | and the averaged signal AVE^ j are added to three-frame-delayed 
integrate signal SUM^.g j and to the three-frame delayed averaged sigil ME^.^^ respectively. However, this is deter- 
mined in accordance with the relation between the frequency of the ac line and the frame frequency of the video signal. 
Thus, this value is not limited to three. 

[0098] Fig, 1.1 is another example of summing units 11 a and lib according to the sixth embodiment 

'5 ' [0099] these summing units 11a and 11b employ circulation type filters. 

[0100] The summing unit 11a includes a multipliers!, an adder 52, a memory 53, and a rhultiplier 54. The multiplier 
51 multiplies the output SUM^i of the integration circuit 1 by a coefficient (1 - k^). The adder 52 adds an output of the 
multipliers to the output of the multiplier 51 . The mernory 53 stores the output of the adder 52 and supplies an output 
which is three-frame-delayed from the output of the adder 52. The multiplier 54 multiplies an output of the memory 53 

20 by the coefficient k^. The coefficient is a predetermined circular coefficient, wherein 0^ k^ ^ 1 . 

[0101] The summing unit lib includes a multiplier 55, an adder 56, a memory 57, and a multiplier 58. The multiplier 
55 multiplies the output AVE^ | of the integration circuit 1 by a coefficient (1 - k^). The adder 56 adds an output of the 
multiplier 58 to the output of the multiplier 55. The memory 57 stores the output of the adder 56 and supplies an output 
which is three-frame-delayed frbm the output of the adder 56. The multiplier 58 multiplies an output of the memory 57 

25 by the coefficient k^. The coefficient k^ is a predetermined circular coefficient, wherein 0^ k^ ^ 1 . 
[0102] Thus, the output of the dividing circuit 4 is represented by: 

D2 = {(1 - k,) X SlJM„. + k X SUM„.3 .}/{(1 : k,) x AVE„i + k, - 

30 

xAVE^3i} 

[01 03] As mentioned above, the integrated signal of the present frame is added to the integrated signal of the three- 
frarne-prior integrated signal and the averaged signal of the present frame is also added to the averaged signal of the 
35 three-frame-prior averaged signal to remove the affection due to the shot image of the object in the video signal. Thus, 
illumination flicker in the case of 50 Hz ac line and 1/30 sec frame period can be favorably detected. 

<SEVENTH EMBODIMENT> 

40 [0104] An illumination flicker detection apparatus according to a seventh embodiment has substantially the same 
, structure as that of the first embodiment. The difference is that the summing units 12a and 12b are further provided. 
[0105] Fig. 12 is a block diagram of the summing units 12a and 12b according to the seventh embodiment. 
[0106] The summing unit 12a includes a merriory 61 "storing the integrated signal SUM^, j and outputting a one-frame- 
delayed integrated signal and a two-frame-delayed integrated signal and an adder 62 for effecting addition among the 

45 two-frame delayed integrated signal SUMn.2.i. the one-frame delayed integrated signal- SUMn.-, i and the integrated 
signal SUMp } and supplies the adding result to the dividing circuit 4. . * 

[0107] The summing unit 12b includes a memory 63 storing the averaged signal AVEn j and outputs a one-frame- 
delayed averaged signal AVE^^ |, a two-frame-delayed averaged signal AVEn.2,p and an adder 64 for affection addition 
among the two-frame delayed averaged signal AVEn.2,i» the one-frame delayed averaged signal AVE^^-, j, and the av- 

50 eraged signal AVE^ j and supplies the adding result to the dividing circuit A. The dividing circuit 4 divides the adding 
result from. the adder 62 by that from the adder 64. Thus, the output of the dividing circuit 4 is represented by: 

D3 = (SUM„^, SUM^, , ^- SUM„.2,i) / (AVE„^ 4. AVE„.,^i ^- 

55 

[0108] In the case of 60 Hz of the ac line, if.the frame period is 1/30 sec, the level variation due to flicker does not. 
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appear every frame because the frame period is an integer times the illuminance variation period. However if ttie 
frequency of the ac line varies around 60 Hz, black strips on a screen move every frame, so that the reproduced image 
is deteriorated. Thus, the integrated signal of the present frame, the one-frame-delayed Integrated signal, and the two- 
frame-delayed Integrated signal are summed and the averaged signal of the present frame, the one-frame-delayed 
averaged signal, and the two-frame-delayed averaged signal are summed to provide stable dividing result. This is 
because it the frequency of the ac line Is 60 Hz and varies around 60 Hz and the frame period is 1/ 30 sec. the video 
signal levels at the same line on the adjacent frames gradually vary. Thus, the video levels at the same lines on the 
adjacent frames are summed and the average at the same lines on the adjacent frames are summed. Then, division 
is effected, so that a stable dividing result is provided. 
- [0109] In this embodiment, adjacent three frames of the integrated signal and the average signal are summed re- 
spectively The number of frames in summing is determined in accordance v/ith the relation between the frequency of 
the ac line and the frame frequency of the video signal. Thus, the number of frames is not limited to three. Accordingly 
illumination flicker developed in the condition that the frequency of the ac line Is 60 Hz and the frame period is 1/30 
sec can be favorably detected. 

<EIGHTH EMBODIMENT> 

[0110] An illumination flicker detection apparatus according to an eighth embodiment has substantially the same 

structure as that of the first embodiment. The difference is that the averaging block 1 3 is further provided. 

[0111] Fig. 13 is a block diagram of the averaging block according to the eighth embodiment. 

[01 12] The averaging block includes a memory 72 and an averaging circuit 73. The memory 72 stores the dividing 

result from the dividing circuit 4 and when the inputted dividing result is j'*' line, the memory 72 outputs the delayed 

dividing results at the {j + p)'h and (j + 2p)ih horizontal lines on the same fieW. The averaging circuit 73 averages the 

dividing results of jth. (j + p)th, and 0 +2p)«h horizontal lines. Thus, the output signal of the averaging block is given by: 

; VB= {(SUM„j;AVE„ j) + (SUM„ j^ pMVE„j, p) + (SUM„j 4- 

2p/AVE„_j^2p)}Xl/3 

[0113] The averaging circuit 73 may be replaced with a median filter to filter the dividing results on the different 
horizontal lines at the same frame showing the same phase in the beat frequency of the flicker component The aver- 
aged signal is supplied to the flicker judging circuit 5. 

[01 14] AS mentioned above, the dividing results at the horizontal line showing the same phase of the flicker compo- 
nent at the same frame are averaged, so that affection in luminance variation level due to the shot image of the object 
in the video signal is removed. 

-cNINTH EMBODIMENT> 

[0115] An illumination flicker detection apparatus according to a ninth embodiment has substantially the same struc- 
ture as that of the first embodiment. The difference is that a threshold value processing' circuit 82 is further provided 
to the flicker judging circuit 5b. The threshold value processing circuit 82 changes.threshold values in accordance with 
a shutter speed signal which is also used for controlling the shutter speed of the imager generating the video siqnal 
supplied to the integration circuit 1. 

[01 16] Fig. 1 4 is a block diagram of the flicker judging circuit 5b according to the ninth embodiment 
[0117] The threshold value processing circuit 82 changes threshold values THgooN^ THeooN. '^^^o-off and 
THeo-OFF "1 accordance with the shutter speed signal to supply the changed values to the comparing circuit 22. 
[0118] Figs. 1 5A and 1 5C are graphical drawings showing the outputs of the dividing circuit 4 when the shutter speed 
js high and low. respectively Figs. 1 58 and 1 5D are graphical drawings showing flicker components detected by the 
DFTcircuitSi when theshutter speed is high and low. respectively. • . 

[01 19] As clearly understood by comparing Fig. 15B with Fig. 15D, the nicker components are relatively high when 
the shutter speed is high but the flicker components are relatively low when the shutter speed is low Then In this 
embodiment; the threshold values are set to be high when the shutter speed is high. On the other hand when the 
shutter speed is low. the threshold values are set to be low in accordance with the shutter speed signal 
[0120] According V. the flicker components are judged more accurateV-by controlling the threshold values which are 
compared with the outputs of the DPT circuit 81. Thus, though . the shutter speed is changed, accurate illumination 
■flicker judgment IS provided. 
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<TENTH EMBODIMENT> 

[0121] An illumination flicker compensation signal generation apparatus according to a tenth embodiment has sub- 
stantially the same structure as that of the first to ninth embodiments. The difference is that a flicker compensation 
5 signal generation circuit 92 Is further provided in addition to the illumination flicker detection apparatus according to 
the first to ninth embodlmems. 

[0122] Fig. 16 is a block diagram of an imaging apparatus according to the tenth embodiment. In Fig. 16, the flicker 
compensation signal generation apparatus 90 is structured as a portion of the imaging apparatus. 
[01 23] The imaging apparatus includes an Imaging device 93 such as MOS type imaging element, an AGC (automatic 
10 gain control) amplifier 94, an a/6 converter 95, the flicker compensation signal generation apparatus 90, and a driving 
circuit 96. The flicker compensation signal generation apparatus 90 Includes the flicker detection circuit 91 and the 
flicker compensation signal generation circuit 92. 

[0124] The imaging device 93 takes an Image and generates the video signal. Particularly, the imaging device 93 
takes an image of an object under illumination of which luminance varies with the periodical voltage variation of the ac 

15 line. The imaging device is driven by the driving circuit 96. The AGC amplifier 94 amplifies the video signal from the 
imaging device 93 with its gain controlled in accordance with an AGC gain control signal. The a/d converter 95 converts 
the video signal from the AGC amplifier 94 into a digital video signal. A flicker detection circuit 91 detects illumination 
flicker from the digital video signal as mentioned In the first to ninth embodiments. The flicker compensation signal 
generation circuit 92 performs illumination flicker compensation with the digital video signal from the a/d converter 95 

20 and the detection result of the flicker detection circuit 91 by generating a shutter speed control signal supplied to the 
driving circuit 96 and the AGC gain control signal supplied to the AGC amplifier 94. 

[0125] Fig. 17 depicts a flow chart showing the operation of the flicker compensation signal generation circuit 92^ 
[0126] In step si . when the flicker compensation signal generation circuit 92 detects power-on, the flickier compen- 
sation signal generation circuit 92 sets the mode of illumination flicker compensation to 50 Hz in step s2. Next, the 
25 flicker compensation signal generation circuit 92 repeatedly executes the operation in the loops including the steps s3 
to sio. 

[0127] In step S3, the flicker compensation signal generation circuit 92 obtains the video level of the digital video 
signal, in the following step s4, the flicker compensation signal generation circuit 92 determines the AGC gain and the 
shutter speed and generates the AGC gain control signal and the shutter speed control signal. In step s5, the flicker 
30 compensation signal generation circuit 92 obtains the illumination flicker detection result. In the following step s6, the 
flicker compensation signal generation circuit 92 judges whether the illumination flicker frequency is 50 Hz. If the illu- 
mination flicker frequency is 50 Hz, the flicker compensation signal generation circuit 92 sets the mode of illumination 
flicker compensation to 50 Hz in step s8. 

[0128] If the illumination flicker frequency is not 50 Hz in step s6. the flicker compensation signal generation circuit 
35 92 judges whether the illumination flicker frequency is 60 Hz in step s7. If the illumination flicker frequency is 60 Hz in 
step s7, the flicker compensation signal generation circuit 92 sets the mode of the illumination flicker to 60 Hz in step 
s9. If the illumination flicker frequency is not 60 Hz in step s7, the flicker compensation signal generation circuit 92 
holds the mode as it is. After steps s8. s9, and si 0, processing returns to step s3. . 

[0129] Figs. 18A and 18B are graphical drawings showing the gain controlling and the shutter controlling referred in 
40 tenth and fifteenth embodiments. ... 

[0130] The flicker compensation signal generation circuit 92 controls the shutter speed and the AGC gain as shown 
in Figs. 1 8A and 18B in the 50 Hz mode. 

[0131] The flicker compensation signal generation circuit 92 obtains brightness in the video image of the digital video 
signal and determines the AGC gain and the shutter speed in accordance with the detected brightness and the flicker 
45 judgment result. In Fig. 18A. "MIN"indicatestheminimumvalueofthe AGC gain and the "MAX" indicates the maximum 
value of the AGC gain. 

[0132] When brightness is low, the shutter speed is determined in accordance with the frame frequency (e.g.. 30 Hz) 
and the frequency of the ac line voltage (e.g.. 50 Hz). Thus, in the low brightness condition, the shutter speed (interval) 
Is 3/100 sec which is the lowest one of values which are integer times a half cycle of the ac line voltage. 

50 [0133] With Increase in the brightness, the AGC gain is gradually reduced. When the AGC gain reaches the minimum 
. of the AGC gain as shown in Fig. 1 8A, the flicker compensation signal generation circuit 92 instantaneously changes 
the shutter speed (interval) to 2/100 sec as shown in Fig. 18B. At the same time, the flicker compensation signal 
generation circuit 92 changes the shutter speed to 3/2 times the minimum value, wherein "3/2" is an inverse number 
of the changing rate of the shutter speed. This prevents the rapidly changing in the brightness in the reproduced video 

55 image around shutter speed changing instance. 

[0134] With further increase in the brightness, the AGC gain is gradually reduced again. When the AGC gain reaches 
the minimum of the AGC gain again, the flicker compensation signal generation circuit 92 instantaneously changes 
the shutter speed (inten/al) to 1/1 CO sec. At the same time, the flicker compensation signal generation circuit 92 changes 
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the shutter speed to twice the minimum value which is an inverse number of the changing rate of the shutter speed. 
[0135] When the shutter speed reaches the maximum shutter speed without flicker, that is, 1/100 sec In 50 Hz, and 
the AGC gain Is minimum, the shutter speed Is Increased (shutter interval is reduced) from 1/100 sec. On the other 
hand, the AGC gain Is held. Thus, the brightness in the video signal is not saturated, so that the dynamic range can 
be Increased. 

[0136] Moreover, favorably, hysteresis Is provided between the shutter speed of 1/1 00 sec and higher shutter speeds 

(e.g., 1/250 sec). 

[0137] The operation mentioned above is for the 50 Hz of the ac line. In the case of 60 Hz, the shutter speed is set 
to values which are Integer times the half cycle of the ac line voltage, that is, 1/120 sec, 2/1 20 sec. 3/120 sec •-. 
[0138] In the circuit example shown in Fig. 1 6, the AGC amplifier 94 is provided and the gain controlling is effected 
in the analog manner. However, it is also possible that a digital AGC control circuit is provided after the a/d converter 
95 instead the AGC amplifier 94 and the digital AGC control circuit is controlled In accordance with the AGC gain control 
signal (data). 

[0139] In the above-mentioned embodiments, the averaging unit 6 effects averaging with the integrated values of 
the present frame and the previous frames. However, It is also possible to average only integrated values of previous 
frames. 

[0140] Moreover, In the above-mentioned embodiments, illumination flicker is detected with MOS type of imager. 
However, this invention Is applicable to the video signal generated from CCD Imaging devices. 
[Q141] As mentioned above, according to the illumination flicker detection apparatus and the method of detecting 
flicker, It is possible to detect illumination flicker developed during shooting images under illumination by ac line voltage 
without affection due to luminance level change of an object in the images because the video signal levels in a plurality 
of frames are averaged and the flicker existent judgment is effected in accordance with the averaged value. Moreover, 
the illuniination flicker detection In the case of 60 Hz of ac lines at the frame frequency of 30 Hz can be provided. 
[0142] Moreover, the shutter speed and the AGC gain are controlled in accordance with the video signal level of the 
inputted video signal and the detected flicker frequency to compensate brightness change due to Illumination flicker. 
Moreover, only the shutter speed is further controlled when the brightness is sufficiently high. This prevents a trouble 
in the reproduced image when the brightness is high. 

<ELEVENTH EMBODIMENT> 

[0143] Fig. 21 is a block diagram of an Illumination flicker detection apparatus according to the eleventh embodiment. 
[0144] The illumination, flicker detection apparatus Includes the Integrating circuit 1 , the averaging unit 6 including 
the memory 2b and the averaging circuit 3. the dividing circuit 1 1 , the flicker judging circuit 5, and a still portion iudaina 

unit 15. K J y y 

[0145] A video signal is inputted to the integrating circuit 1 . The Integrating circuit 1 integrates pixel levels in every 
horizontal line (unit area) in a frame from the video signal. The memory 2b stores the integration result over a plurality 
of frames (fields). The averaging circuit 3 averages the Integration results of horizontal lines at a plurality of frames 
(fields) from the integration result from the integrating circuit 1 and the memory 2b. The dividing circuit 11 divides the 
integration results of horizontal lines by the averaged result of horizontal lines, respectively, when the still portion 
judging unit 15 detects a still portion. The flicker judging circuit 5 judges whether flicker exists in the video signal by 
frequency-analyzing the dividing results of horizontal lines. " 

[0146] This illumination flicker detection apparatus is provided with a discrete circuit in this embodiment. However, 
the illumination flicker detection apparatus is also provided with a Digital Signal Processor (DSP), or a computer with 
a program; 

[0147] The video signal Is generated by a video camera (not shown in Fig. 21) underillumination of which luminance 
vanes in accordance with the voltage change of the ac line. That is. an Image of an object illuminated by fluorescent 
lamps is shot by the video camera. 

[0148] The integration circuit 1 integrates, accumulates, or averages the pixel levels (luminance level) at every hor- 
izontal line. The integrating result of i^^ line of nth frame is represented by SUM^ j as shown in Fig. 2A. If one frame of 
the video signal includes 480 lines, the integration circuit 1 calculates the integration result SUM„ . to SUM„ .an for i = 
. 1 to 480. • 

.[0149]. The memory 2b successively stores a predetermined number of frames (fields) of the integration result. The 
averaging circuit 3 effects addition or averaging among SUM^^ j, SUM^g p and SUM„.3 j from the memory 2b. Fig. 22 
shows the summing or averaging operation from the integration results of the previous frames. The memory 2b stores 
the integration result SUM„ | and outputs the integration results SUM^.^ |. SUM^.g i. SUM„.3 j at the i^^ ime at frames n- 
1 to n-3. The averaging circuit 3d averages (sums) SUM^.^ j, SUMn.2.h and SUM^3 j. The averaging result is represented 
as AVnj. In this embodiment, the number of the previous frames per one unit averaging operation is three. However, 
it is also possible that, at least, the integration results of more than one previous frames are added to the integratiori 
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result of the present frame. 

[01 50] The dividing circuit 1 1 obtains SUM^ /A\/„ j through calculation from the output SUM^, j of the integration circuit 
1 and the output AV„ j of the averaging circuit 3d when the still portion judging unit judges that the block is still. The 
flicker judging circuit 5 judges whether there is flickering with the dividing result of the dividing circuit 11 . Fig. 23 is a 
5 block diagram of the flicker judging circuit 5 according to the eleventh embodiment. The flicker judging circuit 5 includes 
the DFT (Discrete Fourier Transform) circuit 21 , supplied with the integration result SUM„ j and the averaging result 
AVn,i, for delecting frequency Component levels and the comparing circuit 22 for comparing the output of the DFT circuit 21 
with threshold values. 

[0151] The still portion judging unit 1 5 includes a summing circuit 7, a memory 8. and a still portion judging circuit 9. 
10 The still portions judging unit 15 detects a still portion at the image on the screen using the output of the integrations 
circuit 1 . 

[0152] The summing circuit 7 sums the integration results of lines included in N cycles of the flicker component at a 
frame. A portion of a frame including N cycles of flicker component is referred to as a still portion judging block, ft is 
assumed that the top line number at J^^^ still portion judging block at n^*^ frame is k and the number of lines in N (natural 
IS number) cycles of the flicker component at the frame Is p (natural number). Then, the output B-SUM^j of the summing 
circuit 7 is given by: 



20 



[0153] Fig. 24 is an illustration showing the summing operation according to the eleventh embodiment, wherein N = 
1 and j = 1 . As shown in Fig. 1 9A to 1 9D, if the cycle of the ac line used for illumination is 50 Hz and the frame cycle 
is 30 Hz, N lies from one to three. 

[0154] The summing results of the summing circuit 7 obtained as mentioned above are the same with respect to 

25 periodical variation in the luminance of the light source. 

[0155] Fig. 25 is an illustration showing the operation of the still portion judging circuit 9. The memory 8 temporally 
stores the summing results of several frames. The still portion judging circuit 9 calculates difference between the sum- 
ming result B-SUMnj of the present frame from the summing circuit 7 and the one-frame-prior summing result B-SUM^.! j 
from the memory 8 and compares the difference with a threshold value TH-,. When the difference is lower than the 

30 threshold value TH^, the still portion judging circuit 9 judges the block is still portion. 

[0156] As mentioned above, because the flickers component levels at the summing results B-SUM„ | and B-SUMj^.| j 
are the same, the difference represents variation or movement of the image of an object at the still portion judging 
block. Therefore, the still portion Judging block Is judged to be still when the difference is lower than the threshold value 
TH,. 

35 [0157] The dividing circuit 11 calculates division SUM^/AVni from the output SUM„i of the integration circuit 1 and 
the output AVp,} of the averaging circuit 3d when the difference is lower than the threshold value TH^ . When the difference 
is equal to or higher than the threshold value TH^. the dividing circuit 11 does not output the dividing result. 
[0158] Fig. 4A shows the output of the dividing circuit 11 according to the eleventh embodiment, wherein the axis of 
abscissas represents line number at a frame and the axis of ordinates represents levels of dividing results, that is, 

40 SUM^ /AN/p j. The dividing results shows flickering. 

[0159] Fig. 4B shows the output of the DFT circuit 21 according to the first embodiment,' wherein the axis of abscissas 
represents frequency and axis of ordinates represents levels of frequency components. 

[0160] The line F50 represents the level of the DFT circuit 21 at 50 Hz, i.e., component of 50 Hz and the line FSO 

represents the level of the DFT circuit 21 at 60 Hz. i.e., component of 60 Hz. 
45 [0161] The comparing circuit 22 compares the results Fggand FgQOf the DFT circuit 21 with threshold levels TH50-0N. 

TH60.0N. THgo^FF. and THeo-oPF- There are relations. TH50.0N > TH50-0FF and TH60.0N > THgo-oFF- 

[0162] Basically, the comparing circuit 22 compares the component F50 with the threshold levels TH50.0N 

TH50-0FF and the component F^q with the threshold levels THgo-oN and THgo-oPF to detect flicker in the video signal. 

[0163] More specifically, the comparing circuit 22 judges the flicker as follows: 
50 [01 64] When (the value of) F50 < TH50.0FF and (the value of) F^q < THgo^opp. the comparing circuit 22 judges that 

there is no flicker 

[0165] When a x F^q < F50 and F50 > THsq^on^ comparing circuit 22 judges there is flicker of 50 Hz. 
[0166] When p x F50 < F^q and Feo > THgo^DN. comparing circuit 22 judges there is flicker of 60 Hz. 
[0167] In other cases, the comparing circuit 22 judges that it is unknown that there is flicker 
55 [01 68] In the above equations, a Is a weighting coefficient for flicker detection of 50 Hz and p is a weighting coefficient 
for flicker detection of 60 Hz. These coefficients are sufficiently greater than one, so that if the frequency component 
F50 (Fqo) is greater than the value of the weighting-coefficient-times the frequency component Fgo (F50). the comparing 
circuit 22 judges there is flicker of 50 Hz (60 Hz). This reduces probability of en-oneous judgment of existence of flicker 
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due to luminance level change within a frame representing an image. 

[0169] As mentioned above, according to this embodiment, the existence of flicker Is judged from the average of 
integration values over a plurality of frames (fields) including the present frame at the conresponding lines. Thus, the 
flicker detection can be provided without affection of luminance level variation due to motion of the image. l\/loreover. 

s this structure (this method) provides illumination flicker detection of 60 Hz wherein luminance level variation. 

10170] In the eleventh embodiment, the integration circuit 1 integrates the pixel values every horizontal line. However, 
it is also possible that the integration circuit 1 integrates the pixel value on thinned horizontal lines, wherein thinning 
period is sufficiently shorterthan the period of flicker (beat) component. In this case, the circuit stage afterthe integration 
circuit 1 effects the above-mentioned operation for the thinned horizontal lines. Thus, the capacity of the memory 2b 

10 can be reduced. . 
[0171 J In this embodiment, the stilt portion judging unit 15 supplies the result of still portions to the dividing circuit 
1 1 However, it is also possible to use the result in the flicker judging circuit 5. 

<TWELFTH EMBODIMENT> 

15 

[0172] An Illumination flicker detection apparatus according to a twelfth embodiment has substantially the same 
structure as that of the eleventh enibodiment. The difference is that the integrating circuit Id effects integration every 
a plurality of horizontal lines in which the flicker component level is considered to be substantially the same. That is. 
the video (luminance) levels of pixels are integrated every adjacent or consecutive lines. 

20 [0173] Fig. 26 is an illustration showing the operation of the integration circuit 1 d according to the twelfth embodiment. 
[0174] As shown in Fig. 26, the integration circuit Id integrates or averages the video (luminance) level of pixels 
every block (In the drawing, left portions of the two consecutive horizontal lines) in which the flicker component level 
is considered to be substantially the same. Here, the area at which the flicker component level is considered to be 
substantially the same is referred to as a block. The integrated or averaged value of the video level of all effective 

25 pixels at the i^*^ block at nth frame Is represented by SUM^ ^i- 

[01 75] Fig. 27 is an illustration showing the summing or averaging operation from the integration results of the present 
frame and the previous frames. The memory 2b stores the integration result SUM„ and outputs the integration results 
SUMn.Y.bi.SUMn.2^j. SUMn.3 (,iat the i'^^ block at frames n-1 to n-3. The averaging circuit 3d. shown in Fig, 21 . averages 
(sums) SUM^i j. SUM^,2.r and SUM^3 j. The averaging result is represented as AV„ j. In this embodiment, the number 

30 of theprevious framesper one unit averaging operation is three. However,, it is also possible that, at least, the integration 
results of more than one previous frames are summed. ... 

[01761 Fig. 28 is an illustration showing the summing operation according to the twelfth embodiment. The summing 
circuit 7 sums the integration results of horizontal lines at the still portion judging block con-esponding to N cycles of 
the flicker component at a frame. The summing circuit 7 sums the integration results of q blocks at still portion judging 
35 block. It is assumed that the number of the top block is m. The output B-SUM„t,. is given by: 



[0177] As described in the eleventh embodiment. N is a natural number from 1 to 3 when the ac line frequency is 50 
Hz and the frame frequency is 30 Hz. Fig. 28 shows the condition that N = 1 and j = 1 . The summing result of the blocks 
(horizontal lines) corresponding to N cycle of the flicker component shows the same luminance level with respect to 
the. flickering. 

[0178] Fig. 29 is an Illustration showing the still portion judging operations according to the twelfth embodiment The 
still portion judging circuit 9 calculates difference between the summing result B-SUMnbj and the one-frame-prior sum- 
ming result B-SUM^i read from the memory 8 and compares the difference with the threshold value TH^ When the 
difference is lower than the threshold value TH^ the still portion judging circuit 9 judges the stilLportion judging block 
is in the still condition. 

[0179] The still portion judging circuit S supplies the judging result to the dividing circuit 11. The dividing circuit 11 
calculates SUM„b/AV„bi only when the still portion judging block is judged to be still. The flicker judging circuit 6 Judges 
the existence of fl.cker.in accordance with the result SUM„b/AV„bi of the dividing circuit 11 as mentioned above. 
[0180] This embodiment is effective for video signals obtained from imagers using color filters. Figs. 6A and 68 show 
arrangements of color filters for single plate imagers and processing in this embodiment. The arrangement shown in 
Fig. 6A IS for the complementary filter structure and the arrangement shown in Fig. 68 is a portion of Bayer an-angement 
for pnmary colorfilter structure. As shown In Figs. 6A and 68. different color filters are arranged and adhered on imagers 
[01 81 ] In the complementary color filter type of Imager, a first line anda second line are alternately arranged, wherein 
a cyan filter Cy and a yellow filter Ye are altemately arranged every pixel on the first line and a magenta filter Mg and 
- a green filter are altemately arranged every pixel on the second line.- In the integrating the video levels of pixels in two 
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consecutive lines, four pixels surrounded with a chain line are dealt as one block. The video signal level in one block 
is represented as 

^ Cy 4- Mg + Te + G = 2R 4- 3G + 2B = T 

[0182] Then, the video signal level in one block provides substantially the same level as the luminance signal. This 
signal similar to the luminance signal is integrated and the integrated result is used for detecting flicker, so that accurate 
flicker detection is provided. 

10 [01 83] In the arrangement shown in Fig. 6B, one line where R and G filters are alternately arranged and another line 
where G and B filters are alternately arranged. In integration on these two lines, four pixels surrounded by a chain line 
are dealt as one block and values in a plurality of blocks are integrated. The video signal level in one block is represented 
as ■ 

15 

R+G+G+B=R+2G+B=Y 

[0184] Thus, the video signal level in one block is substantially the same as the luminance signal r. This video signal 
simitar to the luminance signal is integrated every a plurality of horizontal lines (two lines), so that accurate flicker 

20 detection is provided. 

[0185] As mentioned above, according to the twelfth embodiment, the integration of video signal levels is effected 
every area in which flicker components can be considered as substantially the same: Further, the integration results 
are summed every stilt portion judging block and the difference between the summing results of the present frame and 
the previous frame is calculated. Only when the difference is lower than the threshold TH^, the dividing circuit. effect 

25 dividing. The flicker judging circuit 5 judges the existence of flier In accordance with the dividing result. 

[0186] In this embodiment, the still portion judging circuit 9 controls the dividing circuit 11 . However, the still portion 
judging circuit 9 may control the flicker judging circuit 5. That is, division is effected irrespective of the still portion 
judging result. The flicker judging circuit 5 judges (outputs) the existence of flier only when the still portion judging block 
is judged to be still. Moreover, the outputting result of the flicker judging circuit 5 may be controlled in accordance with 

30 the output of the still portion judging circuit 9. . 

<THIRTEENTH EMBODIIVIENT> 

[0187] An illumination flicker detection apparatus according to a thirteenth embodiment has substantially the same 
35 structure as that of the eleventh embodiment. The difference is that a dividing circuit 32 is further provided in the still 
portion judging unit 1 5. 

[0188] Fig. 30 is a block diagram of the still portion judging circuit 9b. The still portion judging circuit 9b includes a 
difference calculating circuit 31 , a dividing circuit 32, and a comparing circuit 32. 

[0189] The difference calculating circuit 31 calculates a difference between the summing result B-SUM„| of the 
40 present frame and the summing result of the one-frame-previous frame B-SUMn.ij. The dividing circuit 32 divides the 
difference from the difference calculation circuit 31 by the summing result from the summing circuit 7. The dividing 
result is supplied to the comparing circuit 33. The dividing result.is given by: . 

45 * B-SUM„|-B-SUM^.,j I /B-SUM„j 

[0190] The comparing circuit 33 compares the dividing result with a threshold value TH2. When the dividing result 
is lower than the threshold value THg, the J*^ still portion judging block is judged to be still by the comparing circuit 33. 
The judging result of the still portion judging u nit 1 5, i.e. , the output of the comparing circuit 33 is supplied to the dividing 

50 circuit 1 1 . The dividing circuit 1 1 and the flicker judging circuit 5 judges flicker as similarly as the eleventh embodiment. 
[0191] In the thirteenth ennbodiment, the ratio between the summing result of the present frame and the one-frame- 
previous summing result and the ration, that is, the dividing result is compared with the threshold THg. Thus, though ' 
the video signal level varies, accurate still portion judgnrient is provided, so that the flicker detection can be more 
accurately provided. 

55 . 
<FOURTEENTH EMBODIMENT> 

[0192] An illumination flicker detection apparatus according to a fourteenth embodiment has substantially the same 
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structure as that of the thirteenth embodiment. The difference is that an averaging circuit 41 and a difference calculation 
circuit 42 are further provided in the still portion judging circuit 9c. 

[0193] Fig; 31 is a block diagram of the still portion judging unit 1 5 according to the fourteenth embodiment. The still 
portion judging unit 15 includes the averaging circuit 41 (or averaging the summing result of the summing circuit 7 and 
the one-frame-previous summing result and two^frame-previous summing result from the memory 8, the difference 
calculating circuit 42 for calculating a difference between the summing result of the present frame and the averaging 
result B-AVEpj of the averaging circuit 41 , a dividing circuit 43 for dividing the difference by the summing result of the 
present frame, and a comparing circuit 44 compares the dividing result from the dividing circuit 43 with a threshold TH3 
[0194] The averaging circuit 41 averages the summing result B-SUM„j of the present frame and the one-frame- 
previous summing result B-SUM^^j and two-frame-previous summing result B-SUM„ from the memory 8 to output 
an averaging result B-AVEnj which Is given by: 

B-AVE„j = (B-SUM„j + B-SUM^,j 4- B-SUM^2j) X 1/3 

[0195] The difference calculating circuit 42 calculates a difference between the-summing result B-SUM of the 
present frame and the averaging result AVE- of the averaging circuit 41 . The dividing circuit 43 divides the difference 
by the summing result B-SUMnj of the present frame. The dividing result is given by: . 

I B-SUM„j - B-AVEnj I /B-SUMnj 

[0196] The comparing circuit 44 compares the dividing, result from the dividing circuit 43 with a threshold TH3 When^ 
the dividing result is lower than the threshold TH3, the still portion judging unit 15 judges the still portion judging block 
IS still. The judging result of the still portion judging unit 15. i.e., the output of the comparing circuit 44 is supplied to 
the dividing circuit 11 . The dividing circuit 11 and the flicker judging circuit 5 judges flicker as similarly as the eleventh 

embodiment. 

[0197] In the thirteenth embodiment, a ratio between the summing result B-SUMpj of the present frame and the 
averaging result B-AVE^ derived by averaging the previous frames of summing results and the ratio is compared with 
the threshold TH3; so that video level of the previous frames to be compared with that of the present frame becomes 
stable. Thus, the still portion can be more accurately judged. As the result, accuracy of flicker detection at 50 Hz and 
60 Hz Is improved. 

[0198] Moreover, in the dividing circuit 43. the difference is divided by the summing result B-SUM of the present 
frame. However, dividing the averaging result B-AVEnj instead the summing result B-SUMnj of the present frame 
provides the similar effect. Moreover, the averaging circuit 41 may be provided with the circulation type of filter or the 
FIR filter. 

<FIFTEENTH EMBODIMENT> 

"0 [0199] An illumination flicker compensation signal generation apparatus according to a fifteenth embodiment has 
substantially the same structure as that of the eleventh to fourteenth embodiments. The difference is that a flicker 
compensation signal generation circuit 192 is provided in addition to the illumination flfcker detection apparatus 190 
according to the eleventh to fourteenth embodiments. . . 

[0200] Fig. 32 is a block diagram of an imaging apparatus according to the fifteenth embodiment In Fig 32 the 
45 flicker compensation signal generation apparatus 1 90 is structured as a portion of the imaging apparatus 

[0201] The imaging apparatus Includes an imaging device 193 such as MOS type imaging element, an AGO (auto- 
matic gam control) amplifier 1 94. an a/d converter 1 95. the flicker compensation signal generation apparatus 1 90 and 
a driving circuit 1 96. The flicker compensation signal generation apparatus 1 90 includes the flicker detection circuit 
191 and the flicker compensation signal generation circuit 192. 
so [0202] The imaging device 193 takes an image and generates the video signal. Occasionally, the Imaging device 
193 takes an image of an object under illumination of which luminance varies with.the periodical voltage variation of 
the ac line. The imaging device 193 is driven by the driving circuit 196. The AGO amplifier 194 amplifies the video 
signal from the imaging device 193 with its gain, controlled in accordance with an AGC gain control signal The a/d 
converter 1 95 converts the video signal from the AGC amplifier 1 94 into a digital video signal. A flicker detection circuit 
191 detects illumination flicker from the digital video signal as mentioned in the eleventh to fourteenth embodiments 
The flicker compensation signal generation circuit 1 92 performs illumination flicker compensation with the digital video 
signal from the a/d converter 195 and the detection result of the flicker detection circuit 191 by generating a shutter 
speed control signal supplied to the driving circuit 196 and the AGC gain control signal supplied to the AGC amplifier 



10 



IS 



20 



25 



30 



35 



55 



17 



SOOCID: <EP. 



.1091571A2_I_> 



EP 1 091 571 A2 

194. 

[0203] Fig, 33 depicts a flow chart showing the operation of the flicker compensation signal generation circuit 192 
according to the fifteenth embodiment. 

[0204] In step sii , when the flicker compensation signal generation circuit 192 detects power-on, the flicker com- 
5 pensation signal generation circuit 192 sets the mode of iHuminatlon flicker compensation to 50 Hz In step si2. Next, 
the flicker compensation signal generation circuit 192 repeatedly executes the operation in the loops including the 
steps si 3 to s20. 

[0205] In step s13, the flicker compensation signal generation circuit 192 obtains the video level of the digital video 
signal. In the following step sl4, the flicker compensation signal generation circuit 192 determines the AGO gain and 

10 the shutter speed and generates the AGC gain control signal and the shutter speed control signal. In step S15. the 
flicker compensation signal generation circuit 192 obtains the illumination flicker detection result. In the following step 
si 6. the flicker compensation signal generation circuit 192 judges whether the illumination flicker frequency is 50 Hz. 
If the illumination flicker frequency is 50 Hz, the flicker compensation signal generation circuit 192 sets the mode of 
illumination flicker compensation to 50 Hz in step si 8. 

15 [0206] If the illumination flicker frequency is not 50 Hz in step s1 6, the flicker compensation signal generation circuit 
192 judges whether the illumination flicker frequency is 60 Hz in step si 7. If the illumination flicker frequency is 60 Hz 
in step S17, the flicker compensation signal generation circuit 192 sets the mode of the illumination flicker to 60 Hz in 
step si 9. If the illumination flicker frequency is not 60 Hz in step si 7, the flicker compensation signal generation circuit 
192 holds the mode as it is. After steps si 8, si 9. and s20. processing returns to step si 3. 

20 [0207] Figs. 1 8A and 1 8B show the gain controlling and the shutter controlling operation which was also referred in 
tenth embodiment. 

[0208] The flicker compensation signal generation circuit 1 92 controls the shutter speed and the AGC gain as shown 
in Figs. 1 8A and 18B in the 50 Hz mode. 

[0209] The flicker compensation signal generation circuit 192 obtains brightness in the video image of the digital 
25 video signal and determines the AGC gain and the shutter speed in accordance with the detected brightness and the 
flicker judgment result. In Fig. 18A, "MIN" indicates the minimum value of the AGC gain and the "MAX" indicates the 
maximum value of the AGC gain. 

[021 0] When brightness is low, the shutter speed is determined in accordance with the frame frequency (e.g., 30 Hz) 
and the frequency of the ac line voltage (e.g.. 50 Hz). Thus, in the low brightness condition, the shutter speed (inten/al) 

30 is 3/100 sec which is the lowest one of values which are integer times a half cycle of the ac line voltage. 

[021 1 ] With increase in the brightness, the AGC gain is gradually reduced. When the AGC gain reaches the mi nimum 
of the AGC gain as shown in Fig. 18A, the flicker compensation signal generation circuit 192. instantaneously changes 
the shutter speed (interval) to 2/100 sec as shown in Fig. 18B. At the same time, the flicker compensation signal 
generation circuit 192 changes the shutter speed to 3/2 times the minimum value, wherein "3/2" is an inverse number 

35 of the changing rate of the shutter speed. This prevents the rapidly changing in the brightness in the reproduced video 
image around shutter speed changing instance. 

[021 2] With further increase in the brightness, the AGC gain is gradually reduced again. When the AGC gain reaches 
the minimum MIN of the AGC gain again, the flicker compensation signal generation circuit 1 92 instantaneously chang- 
es the shutter speed (interval) to 1/100 sec. At the same time, the flicker compensation signal generation circuit 192 
^ changes the shutter speed to twice the minimum value which is an inverse number of the changing rate of the shutter 
speed. 

[0213] When the shutter speed reaches the maximum shutter speed without flickering, that is, 1/100 sec in 50 Hz. 
and the AGC gain is minimum, the shutter speed is increased (shutter interval is reduced) from 1/1 00 sec. On the other 
hand, the AGC gain Is held. That is, only the shutter speed is controlled for brightness control. Thus, the brightness in 
, 45 the video signal is not saturated, so that the dynamic range can be expanded. 

[0214] Moreover, favorably, hysteresis is provided between the shutter speed off 1/1 00 sec and higher shutter speeds 
(e.g.. 1/250 sec). 

[0215] The operation mentioned above is for the 50 Hz of the ac line. In the case of 60 Hz, the shutter speed is set 
to values which are integer times the half cycle of the ac line voltage, that is, 1/120 sec. 2/120 sec, 3/120 sec 
50 [021 6] In the circuit example shown in Fig. 32, the AGC amplifier 1 94 is provided and the gain controlling is effected 
in the analog manner. However, it is also possible that a digital AGC control circuit is provided after the a/d converter 
195 instead the AGC amplifier 194 and the digital AGC control circuit is controlled in accordance with the AGC gain 
control signal (data). 

[0217] In the above-mentioned embodiments, the averaging unit 3d effects averaging with the integrated values of 
55 the previous frames. However, It is also possible to average integrated values of previous frames and the present frame. 
[0218] Moreover, in the above-mentioned embodiments, illumination flicker is detected with MOS type of imager. 
However, this invention is applicable to the video signal generated from CCD imaging devices. 
. [0219] As mentioned above, according to the illumination flicker detection apparatus and the method of detecting 
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flicker according to eleventh to fifteenth embodiments, it is possible to detect illumination flicker developed during 
shooting images under illumination by ac line voltage without affection due to luminance level change of an object in 
the images because the flicker is detected at the portion where the image is judged to be still. Thus, flickers due to 50 
Hz ac line voltage and 

5 60 Hz line voltage are automatically detected, respectively. Thus, the flicker compensation Is provided. 

[0220] Moreover, the shutter speed and the AGC gain are controlled in accordance with the video signal level of ihe 
inputted video signal and the detected flicker frequency to compensate brightness change due to illumination flicker 
Moreover, only the shutter speed is further controlled when the brightness is sufficiently high. This prevents a trouble 
in the reproduced image when the brightness is high. That is, when an incident light amount increases, shooting the 

10 object image at a higher shutter speed prevents saturation in the video level. 

<SIXTEENTH EMBODIMENT> 

[0221] Fig. 34 is a block diagram of an ac line frequency detection apparatus according to a sixteenth embodiment 
15 [0222] The ac line frequency detection circuit has substantially the same structure as the illumination flicker detection 
apparatus according to the first embodiment. The difference is thait an ac line frequency detection circuit 32 replaces 
the flicker.judging circuit 5. 

[0223] The ac line frequency detection apparatus includes the integrating circuit 1 , the averaging unit 6 including the 
memory 2 and the averaging circuit 3. the dividing circuit 4. and an ac line frequency detection circuit 32 
20 [0224] A video signal is inputted to the integrating circuit 1 . The integrating circuit 1 integrates pixel levels in every 
horizontal line (nit area) in a frame from the video signal. The memory 2 stores the integration result over a plurality of 
frames (fields). The averaging circuit 3 averages the integration results of horizontal lines at a plurality of frames (fields) 
from the integration result from the integrating circuit 1 and the memory 2. The dividing circuit 4 divides the integration 
results of honzontal lines by the averaged result of horizontal lines, respectively The ac line frequency detection circuit 
32 detects the frequency of an ac line voltage in accordance with the dividing results of horizontal lines. 
[0225] This ac line frequency detection apparatus is provided with a discrete circuit in this embodiment However 
the ac line frequency detection apparatus is also provided with a Digital Signal Processor (DSP), or a comouter with 
a program. • 

[0226] The video signal is generated by a video caniera (not shown in Fig. i ) under illumination of which luminance 
varies in accordance with the voltage change of the ac line. That is, an image of an object, illuminated by fluorescent 
lamps, is shot by a video camera. 
[0227] The integration circuit i integrates, accumulates, or averages the pixel levels (luminance level) at every hor- 
izontal line. The integrating result of i«^ line of nth frame is represented by SUM^ as shown in Fig. 2A. If one frame of 
the video signal includes 480 horizontal Jrnes. the integration circuit 1 calculates the Integratiori results SUM . to 
35 SUM„ for I = 1 to 480. "'^ 

[0228] The memory 2 successively stores a predetermined number of frames (fields) of the integration results, the 
averaging circuit 3 effects addition or averaging among SUM„ j from the integration circuit 1 . SUM^^ j, SUM^ 2i. and 
SUMn.3j from the memory 2. Fig. 2B shows the summing or averaging operation from the integration results of the 
present frame and the previous frames. The memory 2 stores the integration result SUM^ j and outputs the integration 
results SUM„.., i. SUM^.g j. SUM„.3 iBtthe i«h||ne at frames n-1 to n-3. The averaging circuit 3 averages (sums) SUM^j, 
SUM„.i j. SUM^2.h and SUM„.3 j. The averaging result is represented as AVE„ In this' embodiment, the number of 
the previous frames per one unit averaging operation is three. However, it is also' possible that, at least, the integration 
results of more than one previous frames are added to the integration result of the present frame. 
[0229] The dividing circuit 4 obtains SUM, j /AVE„,j through calculation from the output SUM, , of the integration 
circuit 1 and the output AVE„,j of the averaging circuit 3a. The flicker judging circuit 5 judges whether there is flickering 
with the dividing result of the dividing circuit 4. ' 
[0230] The ac line frequency detection circuit 32 judges the existence of illumination flicker in the video signal gen- 
erated with illummation using the ac line voltage and detects frequency of the ac line from the feature of the variation 
in the result of the dividing circuit 4. More specifically the ac line frequency detection circuit 32 detects the ac line 
frequency by analyzing the waveform of the variation In the result of the dividing circuit 4. 

[0231] Fig. 35 is a graphical drawing illustrating the ac line frequency operation according to the sixteenth embodi- 
ment. Rg. 36 depicts a flow chart showing the ac line frequency operation according to the sixteenth embodiment 
[0232] The ac line frequency detection circuit 32 obtains the dividing result from the dividing circuit 4 in step s2l 
Next, the ac line frequency detection circuit 32 detects crossing points di (i = 1 ...) at which the variation in the division 
result crosses level 1 .0 in step s22. The ac line frequency detection circuit 32 calculates intervals (the number of lines 
in the interval) between the two consecutive crossing points (d1 and d2. d2 and d3...) in step s23 as shown in Fig. 35 
[0233] In the following step s24. the ac line frequency detection circuit 32 resets its count CNT to zero. Next the ac 
line frequency detection circuit 32 judges whether each of interval, includes a half of lines con-esponding to one cycle 
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of flicker component to judge that the flicker frequency is developed by the ac line voltage of 50 Hz in steps 25 and 26. 
[0234] Here, the theoretical number of the horizontal lines corresponding to one cycle of the flicker component is 
calculated from the frame frequency, the number of horizontal lines per frame, and the ac line frequency. 
[0235] In step 26. the ac line frequency detection circuit 32 judges that the inten/al includes a half of horizontal lines 
5 corresponding to one cycle of the flicker component of 50 Hz when the number of horizontal lines lies within an allowable 
range from FREQ 50 MIN to FREQ 50 MAX to provide tolerance. 

[0236] If the interval includes a half of horizontal lines corresponding to one cycle of the flicker component of 50 Hz. 
the ac line frequency detection circuit 32 increments its count CNT in step s27 and processing retunns to step s25 to 
repeat the operation in steps s25 to s27 for all lines in one frame. 
10 [0237] In step s25, if all intervals of crossing points within one frame have been judged, processing proceeds to step 

s28. 

[0238] In step s28, the ac line frequency detection circuit 32 compares the counts CNT with a threshold TH4 in step 
s28. If the count CNT is higher than the threshold TH4, the ac line frequency detection circuit 32 judges that there Is 
flicker of 50 Hz in this frame in step s29. If the count CNT is not higher than^the threshold TH4, the ac line frequency 
15 detection circuit 32 judges that there is no flicker of 50 Hz in this frame in step s30 and detects that there is other flicker 
(for example, 60 Hz) as similar to the operation represented by steps s2l to s29. 

[0239] After processing in steps s29 and s30. the ac line frequency detection circuit 32 returns to step S21 through 
the step S31 to repeat the above-mentioned operation of the next frame. 

[0240] As mentioned above, the video levels of pixels at a frame of the video signal generated with illumination 
20 varying with the ac line voltage variation are integrated. The integrated results of frames, including the present frame, 
are averaged with respect to corresponding horizontal lines. The integration result of each line is divided by the aver- 
aging result of each line. The ac line frequency is judged from the frequency analyzing the variation in the dividing 
results. Thus, the ac line frequency measurement is possible without directly detecting the ac line voltage or ac current 
from an ac outlet. 

25 [0241] Moreover, because the judgment is effected using the average between a plurality of frames, the ac line 
frequency is accurately measured without affection of luminance level variation due to movement of an object in the 
screen of the video signal. 

<SEVENTEENTH EMBODIfVIENT> 

30 

[0242] Fig. 37 is a block diagram of an ac line frequency detection apparatus according to a seventeenth embodiment. 
[0243] The ac line frequency detection apparatus has substantially the same structure as that according to the six- 
teenth embodiment. The difference is that an ac line frequency detection circuit 33 replaces the ac line frequency 
detection circuit 32. ■ •. 

35 [0244] Fig. 38 is a block diagram of the ac line frequency detection circuit 33. ' 

[0245] The ac line frequency detection circuit 33 Includes the DFT (Discrete Fou her Transform) circuit 21 . supplied 
with the division result SUM^ | /AV^ j for detecting frequency component levels and the comparing circuit 22 for com- 
paring the output of the DFT circuit 21 with threshold values. 

[0246] The DFT circuit 21 supplied with the division result SUM^ j /AVp j and the comparing circuit 22 for comparing 
40 the output of the DFT circuit 21 with threshold values. 

[0247] Fig. 4A shows the output of the dividing circuit 4, wherein the axis of abscissas represents line number at a 
frame and the axis of ordinates represents levels of dividing results, that Is. SUMn /AVp The dividing results shows 
flicker. 

[0248] Fig. 4B shows the output of the DFT circuit 21 . wherein the axis of abscissas represents frequency and axis 
45 of ordinates represents levels of frequency components. 

[0249] The DFT circuit 21 effects Discrete Fourier Transform operation to output frequency components as shown; 
in Fig. 4B from the division result of the division circuit 4. 

[0250] The line F50 represents the level of the DFT circuit 21 at 50 Hz, i.e., component of 50 Hz and the line FSO 

represents the level of the DFT circuit 21 at 60 Hz, i.e., component of 60 Hz. 
50 [0251] The comparing circuit 22 compares the results F50 and Fgo of the DFT circuit 21 with threshold levels TH500N. 

THgo-oN. THsoOFF. and THgo-oFF- There are relations, THgo^ > TH50.0FF and THgo-oN > THgo-oFF- 

[0252] Basically, the comparing circuit 22 compares the component F50 with the threshold levels TH50.o,^J and 

"^•^so-OFF component F60 with the threshold levels THgo.oi^ and THgQ.opp to detect flicker in the video signal. 

[0253] More specifically, the comparing circuit 22 judges the flicker as follows: 
55 [0254]. When (the value of) F5Q < THgo^opp and (the value of) Fgo < THgo-oFF. comparing circuit 22 judges that 

there is no flicker. 

[0255] When a x F^q < F50 and F50 > THjo^n, the comparing circuit 22 judges there is flicker of 50 Hz. 
[0256] When P x F50 < and F^q > THg^^^,^, the comparing circuit 22 judges there is flicker of 60 Hz. 



MSDOCID: <EP 1091 571 A2J_> 



20 



EP 1 091 571 A2 



10 



[0257] In other cases, the comparing circuit 22 judges that it is unknown that there is flicker 
[0258] In the above equations, a Is a weighting coefficient for flicker detection of 50 Hz and p is a weighting coefficient 
for flicker detection of 60 Hz. These coefficients are sufficiently greater than one, so that if the frequency component 
F50 (Fee) is greater than the value of the weighting-coefficient-times the frequency component f^^ (F50). the comparing 
circuit 22 judges there is flicker of 50 Hz (60 Hz). This reduces probability of en-oneous judgment of existence of flicker 
due to luminance level change within a frame representing an image. 

[0259] As mentioned above, according to this embodiment, the existence of flicker is judged from the average of 
integration values over a plurality of frames (fields) including the present frame at the corresponding lines. Thus, the 
flicker detection can be provided without -affection of luminance level variation due to motion of the image. Moreover, 
this stmcture (this method) provides illumination flicker detection of 60 Hz wherein luminance level variation. 
[0260] In this embodiment, the integration circuit 1 integrates the pixel values every horizontal line. However it is 
also possible that the integration circuit 1 integrates the pixel value on thinned horizontal lines, wherein thinning period 
is sufficiently shorter than the period of flicker (beat) componerit. In this case, the circuit stage after the integration 
circuit 1 effects the above-mentioned operation for the thinned horizontal lines. Thus, the capacity of the memory 2b 
^5 can be reduced. 

[0261] According to this embodiment, the ac line frequency detection apparatus includes the DFT circuit 21 arid the 
comparing circuit 22, so that the presence of illumination flicker at one of various ac line frequencies can be detected 
substantially at the same time. <EIGHTEENTH EMBODIMENT> 

[0262] Fig. 39 is an ac line frequency detection apparatus according to an eighteenth embodiment The ac line 
frequency detection apparatus according to the eighteenth embodiment has substantially the same structure as that 
according to the sixteenth embodiment or the seventeenth embodiment. The difference is that an imaging circuit 200 
IS further provided. The imaging circuit 200 includes an imaging element and a driving circuit (not shown). The imaging 
circuit 200 generates and supplies the video signal to the integrating circuit 1 . The memory 2, the averaging circuit 3 
dividing circuit 4. and the ac line frequency detection circuit 32 (33) detect ac line frequency as mentioned above. Thus, 
the ac line frequency detection apparatus according to the nineteenth embodiment can indirectly detect the existence 
of Illumination flicker and the frequency of the illumination flicker from the image without directly detecting the ac line 
voltage or ac Ime current from the ac outlet. Moreover, because the ac line frequency detection apparatus according 
to the eighteenth embodiment includes the imaging circuit, so that there is no necessity of a unit generating the video 
signal and the cable for supplying the video signal to the integrating circuit. .1 . 
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Claims 



1. 



An illumination flicker detection apparatus comprising: 

integrating means for integrating levels of a video signal at pixels at each of unit areas included in a frame or 
field of said video signal; 

averaging means for averaging said integrated level at each of said unit areas at said frame or field and said 
integrated level at the corresponding unit area at an adjacent previous frame or field; 

dividing means for effecting division between results of said averaging and integrating means every unit area; 
and 

flicker judging means for judging whether flicker exists in said video signal by frequency-analyzing results of 
said dividing means at said unit areas and outputting a judging resuli. 

A n illumination flicker detection apparatus as claimed in claim 1. wherein said unit area is a horizontal line. 

3. An illumination flicker detection apparatus as claimed in claim 1 . wherein said unit area is a plurality of adjacent 
honzontal lines where variation in said levels due to said flicker is negligible. 

4. An illumination flicker detection apparatus as claimed in claim 1 . wherein each of said unit areas includes a plurality 
of honzontal lines with interval at a frame, said horizontal lines showing the same phase in flicker component in 
said video signal. . . 

5. An illumination flicker detection apparatus as claimed in claim 1 , wherein said averaging means comprisinq a 
^ circulation type of filter. 

6. An illumination flicker detection apparatus as claimed in claim 1 . wherein said averaging means comprising a Finite 
Impulse Response filter. . , » 
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7. An illumination flicker detection apparatus as claimed in claim 1 , further comprising: 

first summing means for summing said result of said integrating means at said frame or field and said result 
of said integrating means at another frame or field at every said unit area; and 
s second summing means for summing said results of said averaging means at said frame or field and said 

result of said averaging means at said another frame or field at every unit area, wherein said another frame 
or field is prior to said frame or field by a predetermined number of frames or fields which is determined by a 
frequency of said flicker and a frame frequency of said video signal and said dividing means effects said 
division between said results of first and second summing means. 

10 

8. An illumination flicker detection apparatus as claimed in claim 1, further comprising: 

first summing means for summing said results of said integrating means of a predetermined number of adjacent 
frames or fields at every unit area, said adjacent frames or fields including said frame or field; and 
15 second summing nneans for summing said results of said averaging means of said adjacent frames or fields 

at every unit area, wherein said dividing means effects said division between said results of first and second 
summing means. 

9. An illumination flicker detection apparatus as claimed in claim 1 , further comprising another averaging means for 
20 averaging said results of said dividing means at a plurality . of said unit areas at said frame or field, wherein each 

of said unit areas includes a plurality of horizontal lines with interval at a frame, said horizontal lines showing the 
same phase in flicker component in said video signal. 

10. _An illumination flicker detection apparatus as claimed in claim 1. further comprising threshold level generating 
25 means for generating a threshold level in accordance with a shutter speed control signal which is used for gener- 
ating said video signal, wherein said flicker judging means judges whether said flicker exists in said video signal 
using said threshold level. 

11 . An illumination flicker compensation signal gieneration apparatus comprising: 

30 

integrating means for integrating levels of a video signal at pixels at each of unit areas included in a frame or 
field of said video signal; 

averaging means for averaging said integrated level at each of said unit areas at said frame or field and said 
integrated level at the corresponding unit area at an adjacent frame or field; 
35 dividing means for effecting division between results of said averaging and integrating mieans every unit area; 

flicker judging means for judging whether flicker exists in said video signal by frequency-analyzing results of 
said dividing means at said unit areas and outputting a judging result; and 

flicker compensation means for generating a shutter speed control signal and an automatic gain controlling 
signal for generating said video signal in accordance with said judging result of said flicker judging means to 
40 compensate flicker in said video signal. . ,. . 

12. A method of detecting flicker in a video signal comprising the steps of: . 

(a) integrating video levels of a video signal at pixels at each of unit areas included in a frame or field of said 
45 video signal; 

(b) averaging said integrated level at each of said unit areas at said frame or field and said integrated level at 
the corresponding unit areas at an adjacent frame or field; 

(c) effecting division between results of said steps of (a) and (b) every unit area; and 

(d) judging whether flicker exists in said video signal by frequency-analyzing results of said step (c) at said 
50 unit areas and outputting a judging result. 

13. A method as claimed in claim 12. wherein said unit area is a horizontal line. 

14. A method as claimed in claim 12, wherein said unit area is a plurality of adjacent horizontal lines where variation 
55 of said video levels due to said flickering is negligible. 

15. A method as claimed in claim 12, wherein each of said unit areas includes a plurality of fiorizontal lines with inten/al 
at a frame, said horizontal.lines showing the same phase in flicker component in said video signal. 
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16. A method as claimed in claim 12. wherein said step (b) comprises step of: 

circulating said integrated level every frame or field with a coefficient less than one. 

17. A method as c|aimed in claim 12, wherein said step (b) comprises the steps of: 
5 FInite-lmpulse-Response-flltering said integrated level. 

18. A method as claimed in claim 12, . further comprising: 

(e) summing said result of said step (a) at said frame or field and said result of said step (a) at another frame 
or field at every said unit area; and . 

(f) summing said results of said averaging step at said frame or field and said result of said step (b) at another 
frame or field at every unit area, wherein said another frame or field is prior to said frame or field by a prede- 
termined number of frames or fields which is determined by a frequency of said flicker and a frame frequency 
of said video signal and said dividing means effects said division between said results of said steps (e) and (f). 
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19. A method as claimed in claim 12, further comprising: 



(e) summing said results of said step (a) of a predetermined number of adjacent frames or fields at every unit 
area, said adjacent frames or fields including said frame or field; and 

(0 summing said results of said step (b) of said adjacent frames or fields at every unit area, wherein said 
division is effected between said results of said step (e) and (f). 

20. A method as claimed in claim 1 2, further comprising the step of averaging said results of said step (c) of a plurality 
of said unit areas at said frame or field, wherein each of said unit areas includes a plurality of horizontal lines with 
interval at a frame, said horizontal lines showing the same phase in flicker component in said video. signal. 

21 . A method as claimed in claim 12, further comprising the steps of: 
generating a threshold level in accordance with a shutter speed control signar which is used for generating 

said video signal, wherein it is judged whether said flicker exists in said video signal using said threshold level. 

22. A method of compensating flicker in a video signal comprising the steps of: 

(a) Integrating video levels of a video signal at pixels at each of unit areas included in a frame or field of said 
video signal; 

(b) averaging said integrated level at each of said unit areas at said frame or field and said integrated level at 
the corresponding unit areas at an adjacent frame or field; 

(c) effecting division between results of said steps of (a) and (b) every unit area; and 

(d) judging whether flicker exists in said video signal by frequency-analyzing results of said step (c) at unit 
areas and outputting a judging result; and 

(e) generating a shutter speed control signal and an automatic gain controlling signal in accordance with said 
judging result of said step (d) to compensate flicker in said video signal. 

, 23. An illumination flicker detection apparatus comprising: 



^ integrating means for integrating levels of a video signal at pixels at each of unit areas included in a frame or 

field of said video signal; 

averaging means for averaging said integrated level at each of said unit areas at said frame or field and said 
integrated level at the corresponding unit area at an adjacent frame or field; 

still portion judging means for judging whether image at every block including a portion of said unit areas at a 
^ frame is still in accordance with result of said integrating means; 

dividing means for effecting division between results of said averaging and integrating means every unit area- 
and ' 
flicker judging means for judging whether flicker exists in said video signal in accordance with results of said 
dividing means and said still portion judging means. 



55 



24. An illumination flicker detection apparatus as claimed in claim 23, wherein said unit area is a horizontal line. 

25. An illumination flicker detection, apparatus as claimed in claim 23. wherein said unit area is a plurality of adjacent 
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horizontal lines where variation of said video levels due to said flickering is negligible. 

26. An illumination flicker detection apparatus as claimed in claim 23, wherein said blocks are arranged in the vertical 
direction at a frame or a field, a vertical length of each block is determined in accordance with an integer times 

5 one cycle of illumination variation due to an ac line voltage, used for generating said video signal and a frame 

frequency of said video signal, and said still portion judging means comprises: 

summing means for summing integration results of unit areas at every said block; 

variation detection means for detecting variation in result of said summing means between each of said blocks 
10 of the present frame or field and the corresponding block of a previous frame or field; and 

comparing means for comparing said variation with a threshold value, wherein said still portion judging means 
judges that image at each of said blocks is still when said variation is lower than said threshold value. 

27. An illumination flicker detection apparatus as claimed in claim 26. wherein said variation detection means com- 
15 prises: 

difference calculation means for calculating a difference in results of said summing means between each of 
said blocks of the present frame or field and the corresponding block of a previous frame or field; 
dividing means for dividing result of said difference calculating means by said result of said summing means 
20 of said present frame or field; and 

comparing means for comparing result of said dividing means with a threshold value, wherein said still portion 
judging means judges that image at each of said blocks is still when said result of said dividing means is lower 
than said threshold value. 

25 28. An illumination flicker detection apparatus as claimed in claim 26. wherein said variation detection means com- 
prises: 

variation detection averaging means for averaging results of said summing means between present and pre- 
vious frames or fields at each of said blocks: 
30 difference calculation means for calculating a difference in result of said summing means and said result of 

said variation detection averaging means; 

dividing means for dividing result of said difference calculating means by said result of said summing means 
of said present frame or field; and 

comparing means for comparing result of said dividing means with a threshold yalue, wherein said still portion 
35 judging means judges that image at every block areas is still when said result of said dividing means is lower 

than said threshold value. 

29. An illuminatrori flicker compensation signal generation apparatus comprising: 

40 integrating means for integrating levels of a video signal at pixels at each of unit areas included in a frame or 

field of said video signal; 

averaging means for averaging said integrated level at each of said unit areas at said frame or field and said 
integrated level at the corresponding unit area of at least an adjacent frame or field; 

still portion judging means for judging whether image at every block including a portion of said unit areas at a 
45 frame is still in accordance with result of said integrating means; 

dividing means for effecting division between results of said averaging and integrating means every unit area; 
and 

flicker judging means for judging whether flicker exists in said video signal in accordance with results of said 
dividing means and said still portion judging means ; and 
50 flicker compensation means for generating a shutter speed control signal. and an automatic gain controlling 

signal for generating said video signal in accordance with said judging result of said flicker judging means to 
compensate flicker in said video signal. 

30. A method of compensating flicker in a video signal comprising the steps of: 

55 

(a) integrating levels of a video signal at pixels at each of unit areas included in a frame or field of said video 

signal; 

(b) averaging said integrated level at each of said unit areas at said frame or field and said integrated level at 
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the corresponding unit area at an adjacent frame or field; 

(c) judging whether image at every block including a portion of said unit areas is still in accordance with result 
of said step (a); 

(d) effecting division between results of said steps of (a) and (b) every unit area; and 

5 (e) judging whether flicker exists in said video signal in accordance with results of said steps (c) and (d). 

31. A method as claimed in claim 30, wherein said unit area is a horizontal line. 

32. A method as claimed in claim 30. wherein said unit area is a plurality of adjacent horizontal lines where variation 
10 of said video levels due to said flickering is negligible. 

33. An illumination flicker detection apparatus as claimed in claim 30. wherein said blocks are arranged in the vertical 
direction at a frame or a field, a vertical length of each block is determined in accordance with an integer times 
one cycle of illumination variation due to an ac line voltage, used for generating said video signal, and said step 

^5 (c) comprises the steps of: . 

(f) summing integration results of unit areas at every said block; 

(g) detecting variation in result of said step of (0 between each of said blocks of the present frame or field and 
the corresponding block of a previous frame or field; and 

(h) comparing said variation with a threshold value, 

wherein in said step (c). it is judged that image at each of said blocks is still when said variation is lower than said 
threshold value 
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34. An illumination flicker detection apparatus as claimed in claim 33. wherein said step (g) includes the steps of: 

(i) calculating a difference in results of said step of (f) between each of said blocks of the present frame or 
field and the corresponding block of a previous frame or field; 

(j) dividing result of said step (i) by said result of said step (f) of said present frame or field; and 
^ W comparing result of said step (j) with a threshold value, 

wherein in said step (c) it is judged that image at each of said blocks is still when said result of said step (I) is lower 
than said threshold value. \j/ 

35 35. A method as claimed in claim 33. wherein said step (g) includes the steps of: 

(i) averaging results of said step of (f ) between present and previous frames or fields at each of said blocks- 
(j) calculating a difference in result of said step of (f) and said result of said step (b); 
(k) dividing result of said step (j) by said result of said step (f) of said present frame or field; and 
^ (I) comparing result of said step (k) with a threshold value. 

wherein in said step (c). it is judged.that image at every block areas is still when said result of said step (k) is lower 
than said threshold value. k \ / . 



36. A method of compensating flicker in a video signal comprising the steps of: 

(a) integrating levels of a video signal at pixels at each of unit areas included In a frame or field of said video 
signal; 

(b) averaging said integrated level at each of said unit areas at said frame or field and said Integrated level at 
the con^esponding unit area at an adjacent frame or field; 

(c) judging whether image at every block including a portion of said unit areas is still in accordance with result 
of said step (a); 

(d) effecting division between results of said steps of (a) and (b) every unit area; and 

(e) judging whether flicker exists in said video signal in accordance with results of said steps (c) and (d)- and 

(f) generating a shutter speed control signal and an automatic gain controlling signal for generating said video 
signal in accordance with said judging result of said step (e) to compensate flicker in said video signal. 

37. An ac line frequency detection apparatus comprising: 
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flicker component detection means for detecting a flicker component in a video signal generated with illumi- 
nation of which luminance varies with ac line voltage; and 

flicker judging means for judging whether flicker exists in said video, signal .in accordance with said detected 
. flicker component and outputting the judging result. 

5 

38. An ac line frequency deteciiori apparatus as claimed in claim 37. wherein said flicker component detection, means 

comprises: 

integrating means for integrating levels of said video signal at pixels at each of unit areas included in a frame 
10 i orfieldof said video signal; 

averaging means for averaging said integrated level at each of said unit areas at said frame or field and said 
integrated level at the corresponding unit area at an adjacent frame or field; . 

dividing means for effecting division between results of said averaging and integrating means every unit area 
to output said detected flicker component. 

39. An ac line frequency detection apparatus as claimed in claim 37, wherein said flicker judging means comprises: 

variation analyzing means for analyzing variation of said detected f lickercomponent with respect to horizontal 
lines. .. 

20 40. An ac line frequency, detection apparatus as claimed in claim 37. wherein said flicker judging means comprises: 
spectrum analyzing means for analyzing spectrum of said flicker conrjponenl. 

41. An ac line frequency detection apparatus as claimed in claim 37, wherein said unit area is a horizontal line. 

25 42. An ac line frequency measuring apparatus comprising: 

imaging means for generating a video signal with illumination of which luminance varies with ac line voltage; 
flicker component detection means for detecting a flicker component In said video signal; and 
frequency detection means for delecting a frequency of said flicker component from said flicker component 
30 detection means. 

43. A method of measuring an ac line frequency comprising the steps of: 

(a) detecting a flicker component In a.vldeo signal generated with Illumination of which luminance varies with 
35. acline voltage; and. 

(b) judging whether flicker exists in said video signal In accordancis with said detected flicker component. 

44. A method as claimed in claim 43, wherein said step (a) comprising steps of: 

^ integrating levels of said video signal at pixels at each of unit areas included in a frame or field of said video 

signal; 

averaging said iritegrated level at each of said unjt areas at said frame or field and said integrated level at the 
corresponding unit area of at an adjacent frame or field; 

effecting division between results of said averaging and integrating steps every unit area to output said detected 
45 flicker component. 

45. A method as claimed in claim 43. wherein said step (b) comprising steps of: 

analyzing variation of said detected flicker component with respect to horizontal lines. 

50 .46. A method, as claimed in claim 43, wherein said step (b) comprising steps of: 
analyzing spectrum of said flicker component. 

47. A method as claimed in claim 43, wherein said unit area is a horizontal line. 
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(54) Apparatus and methods for detection and 
and measurement of AC line frequency 

(57) A video signal including illunnination flicker 
component Is integrated at each of unit areas (horizontal 
lines) In a frame (field) of the video signal. The Integrated 
level at each of the unit areas at the frame and the inte- 
grated level at the corresponding unit area of an adja- 
cent frame are averaged. Dividing is effected between 
results of the averaging and integrating every unit area. 
It is judged whether flicker exists in the video signal by 
frequency-analyzing results of the dividing result at the 
unit areas. The unit area may be plural adjacent lines 
where flickering are negligible. The averaging circuit 



compensation of illumination flicker, detection 



may be circulation type of or FIR filter. Threshold level 
forjudging the flicker is changed according to a shutter 
speed control signal. Flicker compensation may be ex- 
ecuted by controlling shutter speed or the AGO accord- 
ing to flicker judging result. A still condition at a block in 
a frame may be detected from the Integration result at 
plural frames. When the block is judged to be still, the 
flicker is judged. An ac line frequency detection Is also 
disclosed to detect the frequency of the ac line from a 
video signal generated under Illumination including flick- 
er. An imaging circuit may be provided to generate the 
video signal therein. 
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